Vyvyan married Phillipa Tremayne (c. 1555–1612) in 1574, and they had several children. His eldest son, Sir Francis (died 1635), was also an MP and Sheriff as well as another son, Michael, who was MP for St Mawes. His grandson, Sir Richard, was the first Baronet of Trelowarren in 1645.