The palace was built between 1639-42 by Lorenzo de Sent for Crown Grand Chancellor Jerzy Ossoliński in Mannerist style.
In the middle of the 17th Century, a residence was built for Kanclerz Jan Leszczynski which was probably designed by Giovanni Battista Gisleni.
Many of them were prominent Polish figures, including luminaries such as Ignacy Krasicki, Franciszek Bohomolec, Adam Naruszewicz, Ignacy Potocki, Hugo Kołłątaj, Jan and Jędrzej Śniadecki, Stanisław Konarski, Tomasz Adam Ostrowski and Chancellor Andrzej Zamoyski.