Son of John Pitt, consul at Masulipatam, and his wife Sarah Charlton, he was a grandson of Edward Pitt and Rachel Morton.