He was born September 19, 1843, at Hycotee in Caswell County, North Carolina, the son of Richard Ivy Smith (1800–1871) and Mary Amis Goodwin Smith (1815–1889).