The outer-walls of the garbhagrha and sukansi have, besides pilasters and turrets, two rows of figures representing mostly Vishnu and his Avatars such as Hayagriva, Narasimha, Lakshminarayana, Venugopala, Kalinga-Mardana and Govardhanadhari.
The figure of Yutog Yontan Gonpo is often portrayed surrounded by the five buddhas above, the eight Medicine Goddesses at the sides, his special yidam Black Hayagriva accompanied by four goddesses below.
Sayani, the first wife of Kalia Bhomora Borphukan donated a family of paiks and also a plot of land for their maintenance to the Hayagriva Madhava temple during the reign of Ahom king Kamaleswar Singha.