Herbert Armitage James, who was Headmaster of Rugby School and later President of St John's College, Oxford, grew up in Panteg and is commemorated by a memorial in the parish church, where his father was rector from 1856 to 1871.
His early rugby career began playing for New Panteg RFC, playing alongside current Welsh Number 8 and cousin Toby Faletau.