On 17 February 1697/98, he married Elizabeth Gould, daughter of John Gould and sister of Sir Nathaniel Gould, at St Peter le Poer in London, and had by her a daughter and a son, Mary and William Henry.
On 10 July 1711, he married Frances Gould, daughter of John Gould, his brother's brother-in-law and a Director of the East India Company, at St Peter le Poer in London.
In 1771 Angerstein married Anna Crockett (widow of Charles Crockett and daughter of Henry Muilman (1700–1772) a South Sea Company director, banker, Danish consul in London and Russia Company consul, and Anne née Darnall) at St Peter-le-Poer, Old Broad Street.
St Peter le Poer was a church on the west side of Broad Street in the City of London.
Peter Pan | Peter Gabriel | Peter Jackson | Peter | Saint Peter | Peter Paul Rubens | Peter Sellers | Peter the Great | Blue Peter | Peter Frampton | Peter Greenaway | Peter Brook | Peter Lorre | Peter Ustinov | St. Peter's Basilica | Peter Kropotkin | St. Peter | Peter Fonda | Peter Kay | Peter David | Peter Mandelson | Peter O'Toole | Peter Allen | Lord Peter Wimsey | Peter Sellars | Peter Schreier | Peter, Paul and Mary | Peter Davison | Peter Singer | Peter Maxwell Davies |