Leonard Elmhirst was born into a landed gentry family in Worsbrough (now part of Barnsley, Yorkshire), where the family seat is Houndhill.