Born John Lee Hanning on 11 December 1802, he was the only son, and heir, of William Hanning (d. 1834) of Dillington House, near Ilminster in Somerset, and Harriett Lee, daughter of Edward Lee of Pinhoe, Devon.[2]
In 1819 at the age of 17, by the will of his uncle, Maj. Edward Lee, who died in 1819, he inherited several estates including Orleigh.[3] Under the terms of the bequest he adopted the surname Lee by royal licence dated 21 March 1825.[4] He let Orleigh to his brother-in-law, William Speke, of Jordans near Ilminster (father of the River Nile explorer John Hanning Speke)[5] and made his own residence at Dillington.[6]
Lee married twice. His first marriage was in 1834 to Jessy Edwards-Vaughan (d. 1836), the daughter of John Edwards-Vaughan of Rheola who was his fellow MP for Wells from 1830 to 1832.[7] By her he had one son:
Emily Mary Lee (c. 1842–1893), who married Thomas Spragging Godfrey of Balderton Hall, Nottinghamshire, in 1864. After his death in 1877, she married Maj.-Gen. Henry Lowther Balfour of the Royal Artillery in 1882.[9]
Alice Georgina Lee (1844–1860), who died unmarried.[9]
Edward Hanning-Lee (1845–1916), a Colonel who married Georgiana Emma Marjoribanks, daughter of Edward Marjoribanks.[9]
William Hanning-Lee (1846–1912), who married Emilie Georgiana Bond in 1877.[9]
He died on 16 August 1874 at the age of 71.[3] His widow died on 29 January 1888.[6]