He married the Hon. Mary Lawless, daughter of Valentine Lawless, 2nd Baron Cloncurry, and his first wife Elizabeth Georgiana Morgan, and had three children, Sussex junior, Berkeley and Charles. The marriage caused some comment as Mary had divorced her first husband, Henry Fock, 3rd Baron De Robeck, to marry him, an unusual step for the time (although her parents' marriage had also ended in divorce, following a notorious lawsuit by her father against her mother for criminal conversation).
