He was the second son of Joseph Tylor, brassfounder, by his wife, Harriet Skipper, and elder brother of the anthropologist Edward Burnett Tylor.