After the Reformation and the Act of Supremacy 1558, in 1600, Thomas Gunter, a local Roman Catholic, built the house. A secret chapel was constructed in the attic.[2]
On 12 April 1678, John Arnold (the MP for Monmouthshire), a fanatical anti-Catholic, told the House of Commons, ‘that he had seen a public chapel near the house of Mr Thomas Gunter, a papist convict, in Abergavenny, adorned with the mark of the Jesuits on the outside, and is informed that Mass is said there by Captain Evans, a reported Jesuit, and by the aforesaid David Lewis in that very great numbers resort to the said chapel and very often at Church time, and he hath credibly heard that hundreds have gone out of the said chapel when not forty have gone out of the said church, that the said chapel is situate in a public street of the said town, and doth front the street.'[3]
The younger Thomas Gunter had been notably indiscreet about his harbouring of Catholic priests,[4] although this was a felony under the Jesuits, etc. Act 1584. Taking advantage of the tolerant religious atmosphere following the Restoration of Charles II, he told the local vicar frankly that "he had kept a priest in Oliver Cromwell's time, and would keep one now".[4] Like most Catholic landowners he failed to anticipate that the outbreak of the Popish Plot would force the King, despite his own pro-Catholic leanings, to insist on stricter enforcement of the Penal Laws.[5] The laity were reminded that harbouring priests was a crime, which carried the death penalty, although neither Gunter nor any other Catholic layman was actually prosecuted for this offence.
In 1864, the central area of the house was divided from the rest and became the Parrot Inn. In 1898, it became the Cardiff Arms.[2] In 1907, two brothers, Thomas and Edwin Foster bought and repaired the building. They discovered evidence of the existence of the chapel in the attic. A mural showing the Adoration of the Magi was found and given to the Abergavenny Castle Museum along with the original door from the front entrance.[6] Other than repairs to the chimney in 1913, and an extension to the rear of the house, the building has not been altered since 1907.[2] In January 2017, the building was bought by the Welsh Georgian Trust.
