He was born in Letheringsett, Norfolk in 1838, the second son of William Hardy Cozens-Hardy and was educated at Amersham School.