His grandfather was David Erskine, 2nd Lord Cardross, while his mother, Anna, the daughter and heiress of Sir William Dundas of Kincavel, was his father's second wife.