Ryder married in 1799 Frederica, daughter of Sir John Skynner, from whom Ryder inherited the Great House in Great Milton, Oxfordshire in 1805. There were no surviving children from this marriage. Frederica died in August 1821. Ryder survived her by eleven years and died in September 1832, aged 66.