His only child, Frances (1750–1820), became the second wife of Charles Howard, 11th Duke of Norfolk, but became insane and was locked away for many years. After her death without children, the estate of Holme Lacy fell into extensive litigation, eventually settling on Sir Edwin Stanhope, 3rd Baronet, who adopted the additional surname Scudamore.[2]