The first stone castle is thought to have been built by Gospatric, Earl of Northumbria, after his exile from England, following the Harrowing of the North, by William the Conqueror after Gospatric took refuge at the court of Malcolm III of Scotland.
He was sent to the north as earl from 1068 to 1069 after the deposition of Gospatric.
The manors of Workington and Lamplugh in Cumberland were given by William de Lancaster, in exchange for Middleton in Westmorland, to a relative, Gospatric, son of Orme, brother-in-law of Waldeve, Lord of Allerdale.