On 27 June 1796, Talbot married Lady Elizabeth Somerset, daughter of Henry Somerset, 5th Duke of Beaufort and his wife Elizabeth Boscawen.[3] They had 14 children, including:[1]
Maria Charlotte Talbot (d. 1827), who married Henry Every, son of Sir Henry Every, 9th Baronet. However she died a year after their marriage without issue.[1]
Georgiana Elizabeth Talbot (d. 1885), who married Rev. Augustus Philip Clayton, son of Sir William Clayton, 4th Baronet. They had a son, and daughter.[1]
Rear-Adm. Charles Talbot (1801–1876), who also married a daughter of Maj.-Gen. Ponsonby, the Hon. Charlotte Georgiana Ponsonby. They had seven children.[1]
Col. George Talbot (1809–1871), who married Frances West, daughter of Lt.-Col. F. Ralph West of the 33rd Regiment. They had a son, Maj.-Gen. FitzRoy Somerset Talbot.[1]