Henry was a natural son of the HonourableHenry Fane, Clerk to H.M. Treasury, a younger son of Thomas Fane, 8th Earl of Westmorland.[3] He was brought up with the rest of Fane's children as a supposed distant relative, but when Chamberlain expressed interest in one of Fane's daughters (his half sister), he was informed of his true parentage and posted to Portugal in 1829 to become consul general, sailing on board HMS Briton.[4]
On 1 January 1795 he married firstly Elizabeth Harrod, of Exeter, and in 1813 they were divorced by an Act of Parliament. Their children were: