On 20 July 1700, he married Marie Gabrielle d'Audibert de Lussan, daughter and heiress of Jean d'Audibert, Comte de Lussan and Marie Françoise Raimond. He had a posthumous daughter, Lady Christine Marie Jacqueline Henriette FitzJames, born 29 May 1703 at Bagnols sur Cèze, Languedoc, France, who became a nun. His widow remarried in May 1707, at Saint-Germain-en-Laye, John Drummond, Marquess of Forth, later 2nd Duke of Melfort (1682–1754).