Kaye was born about 1670, the third but eldest surviving son of Sir John Kaye, 2nd Baronet. He matriculated at Christ Church, Oxford on 2 March 1686, aged 15. He succeeded his father in the baronetcy on 8 August 1706.[1]
Kaye died on 10 July 1726 leaving one daughter, Elizabeth, who married George Legge, Viscount Lewisham, the heir of the 1st Earl of Dartmouth. Viscount Legge died soon afterwards in 1732, to be succeeded in turn by his eldest son, William Legge, 2nd Earl of Dartmouth.