He was Lieut-Colonel off the Angus regiment and he married Anne daughter of Colonel George Hay grandfather of Andrew 11th Earl of Erroll and a noted Royalist.
The castle was the seat of the Grahams of Fintry and remained so until the 19th century when Robert Graham of Fintry sold the lands to David Erskine, with the condition that his family could retain the territorial title of Graham of Fintry and that the estate revert to the older name of Lumlathen or Linlathen.