With its strong stone and oak facade, Grumblethorpe was known as "John Wister's Big House." In the early 19th century, Charles Jones Wister gave the house its name, from the popular comical novel Thinks-I-To-Myself by Edward Nares.