As Huis Sorgvliet it was built on the site of a former farm (probably part of the living quarters was worked in the left wing) by Jacob Cats (1577–1660), a prominent poet and politician who lived there since 14 July 1652.