At the heart of Wharton Hall is a 15th-century hall, built from local limestone by the local Wharton, possibly Richard Wharton.[1] During the Pilgrimage of Grace in 1536 the manor was besieged by the forces of Robert Aske and after 1544 Lord Wharton extended and fortified the manor, building a gatehouse, great hall, kitchen, and surrounding walls in a medieval style.[2] The result was a grand property, with the great hall being 68 feet long.[3]
The Wharton family preferred to use Healaugh Priory near Tadcaster in North Yorkshire as their main residence after the 16th century, and the property fell into ruin. In 1785, Lord Lonsdale restored the building, adding more battlements.[6] It was restored again in the 20th century to its current condition.[7]