The manor of Withycombe was centred on the village. In about 1212 the manor was split into two separate sub-manors, which took various names over time, dependent on the family name of their lords.[3] By the 16th century the names of the two manors were "Withycombe Wyke" (or Weeke, etc.) and "Withycombe Hadley". The former manor house of Withycombe Hadley survives as Court Place in the village of Withycombe.
The Hadley family inherited the manor of Withycombe by marriage to the heiress of the Durborough family.[3] The manor passed to the Lutterell family when Margaret Hadley married Thomas Luttrell in 1560.[4] At some time before 1777 John Fownes Luttrell acquired the other sub-manor of Withycombe Weke,[3] and thus the manor of Withycombe was unified to its pre-1212 position.
The parish council has responsibility for local issues, including setting an annual precept (local rate) to cover the council's operating costs and producing annual accounts for public scrutiny. The parish council evaluates local planning applications and works with the local police, district council officers, and neighbourhood watch groups on matters of crime, security, and traffic. The parish council's role also includes initiating projects for the maintenance and repair of parish facilities, as well as consulting with the district council on the maintenance, repair, and improvement of highways, drainage, footpaths, public transport, and street cleaning. Conservation matters (including trees and listed buildings) and environmental issues are also the responsibility of the council.
The Church of St Nicholas dates from the 13th century and has been designated by English Heritage as a grade I listed building.[8] Hidden in a wall recess is a figure of an unknown man with long hair and a hat, which is one of the earliest church monuments to include a hat. He is carrying a heartcase to show he died elsewhere and only his heart was brought to the church for burial.[9]