The first records of the church indicate it was rebuilt some time after 1066 by the Lord of the Manor, William Paganel, who gave it, with other possessions of his, to Drax Priory in the time of Archbishop Thurstan (1119–1140).
Throughout his archbishopric, William was embroiled in a dispute with Thurstan, the Archbishop of York, over the primacy of Canterbury.
The manor was handed down via lines of the interconnected Wintershull/Wintershall, Bassett, Unwyn, Windsor, Wolley and Wroth family from Thurstan le Dispenser at the time of the Testa de Nevill into ultimately the major landholdings of the Earls Onslow in the 18th century, historically the Earl of Surrey who held it until the early 20th century.
They have generally been called Nereids, though Thurstan Robinson argues that this is imposing a Greek perspective on Lycian sculptures, and that they should rather be seen as eliyãna, Lycian water-nymphs associated with fresh-water sources and referenced on the Letoon trilingual inscription, which was discovered a few kilometres to the south of the site of the Monument.