For services rendered king Maximilian gave the estate to Juraj Draskovic (1525-1587), first personally, then as the family heritage. So finally in 1584 Trakoscan belongs to Draskovic family.
In the boom years of building castles in Croatian Zagorje, in the second half of the 18th century Trakoscan was abandoned. Neglected, it begins to deteriorate rapidly so just in the second half of the 19th century, the family re-interested in its estate in the spirit of the new era romantic return to nature and family traditions. In this spirit marshal Juraj V. Draskovic in residential castle and the surrounding park was transformed into a romantic garden. The next generation occasionally stay in Trakoscan until 1944 when they immigrated to Austria soon after the castle was nationalized.