According to the oral tradition, Shōgen-ji was initially built as a Tendai temple during Saicho's visit to Eastern Japan in 817.