In the 16th century, Kavarskas and the surrounding area belonged to nobles Astikai, later – Ogiński (Oginskiai), Tyszkiewicz (Tiškevičiai), and Siesickiai.
Marcjan Aleksander Ogiński may be the subject of a much debated work, Rembrandt's The Polish Rider.