At the head of the Vale is the Gospel Pass, which is reputed to have been named after the time in the 12th century when the Third Crusade passed through the area preaching and fund raising. Nearby, at Capel-y-ffin, is an 18th-century church or chapel, one of the smallest in the country, and close to the former home of designer Eric Gill. Further south near the valley entrance, at Cwmyoy, the church there has suffered gradual subsidence over the centuries, and is best known for the disorienting tilts and twists of the building which add to its character. A few miles away, further into the Black Mountains, is Partrishow or Patricio, which has an outstanding 11th-century church.
Bruce Chatwin's book On the Black Hill depicts the upland livestock farming community over the past 100 years or so in the area. A locally born writer and academic Raymond Williams may well have set to restore the balance with his two books on the People of the Black Mountains, written a few years afterwards.
The Priory was formerly an Augustinian monastery until the dissolution of the Monasteries by Henry VIII. The ruins are protected by Cadw and access is free; however, dogs are barred from entering. The ruins were much painted in the 18th and 19th century, including and famously by J. M. W. Turner. The associated lodgings still attached to the ruins and known as The Abbey Hotel, are still used and there is a cellar pub where refreshments can be had during regular opening hours. The road from either Hay in the north or Llanfihangel Crucorney is, however, only a single track and delays may occur when the road is busy.
