Not much is know of Elemo's early life but by 1956 he had had an Islamic education and was living in Dire Dawa working for a wealthy Arab merchant who eventually took him to Aden, Yemen in 1956.