Kraft was born in New Haven and studied music at Yale University under Horatio Parker before becoming became the organist at St. Thomas's Church in Brooklyn, N.Y. He then went to Europe for three years, studying organ with Grunecke in Berlin and Alexandre Guilmant and Charles-Marie Widor in Paris.