Edwards was born in 1768 in Usk, Monmouthshire, the son of Lloyd Pittell Edwards, a schoolmaster and organist, and his wife, Mary Reese, who had been married on 26 September 1765 at Llantilio Crossenny Church and where Sydenham was christened in 1768.