The building of the castle (and another folly called the rotunda), was started in 1747 while Sir Thomas Lyttelton was still alive (he died in 1751) so he was not opposed to the modernisation of his park with suitable fashionable ornamental follies, but the credit for its creation is usually given to his son and heir Gorge Lyttelton (the future 1st Lord Lyttelton).
The obelisk was commissioned by Sir Richard Lyttelton, a son of the elderly Sir Thomas Lyttelton, the owner of the nearby Hagley Hall.
Thomas Jefferson | Sir | Thomas Edison | Sir Walter Scott | Thomas | Thomas Hardy | Thomas Mann | Thomas Aquinas | baronet | Clarence Thomas | Thomas Gainsborough | Baronet | Dylan Thomas | Thomas Pynchon | St. Thomas | Saint Thomas, U.S. Virgin Islands | Thomas Carlyle | Thomas the Tank Engine | Thomas Moore | Thomas Cromwell | Thomas Becket | Thomas the Apostle | Thomas Merton | Thomas Tallis | Thomas Paine | Sir Arthur Conan Doyle | Roy Thomas | Thomas Telford | Thomas More | Thomas Wentworth, 1st Earl of Strafford |
His father, William Harcourt Isham Mackworth (1806—1872), a younger son of Sir Digby Mackworth, the 3rd Baronet, took the additional surname Dolben after he married Frances, the heiress of Sir John English Dolben, the 4th Baronet.
Sir Thomas Lyttelton, 1st Baronet (1593 – 22 February 1650) was the eldest son of John Lyttelton and inherited the family estates in Frankley, Halesowen, Hagley, and Upper Arley from his mother, Meriel, the daughter of Sir Thomas Bromley, Lord Chancellor of England.