Grigson was born in 1896 in the Vicarage at Pelynt to Canon William Shuckforth Grigson and Mary Beatrice Boldero, and was one of seven brothers, including Geoffrey Grigson, Kenneth Grigson and John Grigson.