He served his apprenticeship in the Port of London, initially working as a lighterman but eventually, in light of his physical prowess (Broughton was nearly 6 feet tall and very muscular, weighing over 14 stone, or approximately 196 pounds), working as a waterman rowing passengers on the River Thames.