It is conjoined with Brough that lies to the south-east, with which it forms the civil parish of Elloughton-cum-Brough.
Wauldby was recorded in the 11th century Doomsday survey as "Waldbi", with a population, together with Elloughton, of 36 villeins, 3 smallholders and a priest.