The two-story mansion was built for Hilarie Carlin circa 1835.[3] It was acquired by Richard A. Wilkins in 1846.[3] Wilkins's sister, Sally, married George Pickett in this house in 1851; he later served as a general in the Confederate States Army during the American Civil War of 1861–1865.[3]
In 1883, it was purchased by Murphy J. Foster, who served as the 31st Governor of Louisiana from 1892 to 1900 and focused on voter disenfranchisement.[3][4] The house was inherited by his granddaughter, Mrs Langfitt Bowditch Wilby.[3]