In 1865, the house was purchased by Major Peyton Rowan, who lived there with his wife, the former Miss Forney, and their four children, John Forney, Sallie Lorene, Mary Emma and George Hoke.[2] Rowan was a merchant and Mason; the family lived in the house until 1906.[2] It was later inherited by their granddaughter Anne and her husband, T. Weller Smith.[2]