From 1469 to 1546 it belonged to the noble family of Thurzo and the rich merchants Fuggers.
Thurzo first married Ursula Boehm and the couple had three sons: György Thurzó who married Anna Fugger, later György Thurzó became the major of Kraków; another son of János, became the archbishop of Breslau (today Wroclaw); and their third son became the bishop of Olomouc.