Brydges was the second surviving son of Sir Thomas Bridges of Keynsham, Somerset and his wife Anne Rodney, the daughter and coheiress of Sir Edward Rodney of Stoke Rodney, Somerset. He was a captain in the Duke of York's independent company from 1673 until after 1675 serving in the Portsmouth garrison. He got into debt and in 1677 he recovered his fortune by marrying Anna Maria Talbot, Countess of Shrewsbury. She was born Lady Anna Maria Brudenell, daughter of Robert, 2nd Earl of Cardigan, was widow of Francis Talbot, 11th Earl of Shrewsbury and notorious as mistress of the 2nd Duke of Buckingham. In doing so, he brought an action for jactitation of marriage against Ann Smith, a shopkeeper with whom he had been living for some years.[1]
Brydges' wife bought him a post as Groom of the Bedchamber in 1678. He was appointed to the lieutenancy for Staffordshire in 1680 and stood for Parliament at Lichfield in the 1681 general election. Some time before 1685, he bought Avington Park and considerably remodelled the house.[2] He entertained Charles II there while the King's house at Winchester was being built. On the accession of James II in 1685 he lost his post as Groom of the Bedchamber, but remained loyal to the King until the Glorious Revolution.[1]
Brydges developed gangrene after treating an ingrowing toenail just before the last election. He lingered on until 1714 and was buried on 9 February 1714 at St. Giles-in-the-Fields. He was succeeded by his son George.[1]