Born in Houston, Texas to a Jewish family, Hoffman lived most of his childhood in Lexington, Kentucky, attending Henry Clay High School.