Baberton House was designed and built in 1623 by the architect Sir James Murray of Kilbaberton (d.1634), King's Master of Works.