It was often visited by Yoritomo, his wife Hōjō Masako, and their descendants, who liked spending time there.
Two yagura are dedicated to Hōjō Masako and her son Minamoto no Sanetomo, who was assassinated while still young by nephew Kugyō on the stairs of Tsurugaoka Hachiman-gū.
Sasaki was later selected to be one of the tutors involved in the education of Crown Prince Haru (the future Emperor Taishō), as well as Emperor Meiji’s daughters, Princesses Masako and Fusako.