In 1788 he succeeded his brother-in-law, Sir William Lowther, in the rectory of Swillington, which he held until his death.
However, as with many other places the "-in-Elmet" has been lost in modern times with only a few exceptions such as Barwick-in-Elmet and Sherburn-in-Elmet surviving.
Lowther was the son of Sir William Lowther, 1st Baronet, of Little Preston and Swillington, and his wife Anne Zouch.
It skirts St Aidan's Country Park, and crosses the River Aire at Swillington Bridge.