In April 1862, General Grant's troops landed at Milliken's Bend before the siege of Vicksburg and occupied the Sparta Plantation. During the course of the siege, Union forces confiscated the Hermione House, on the Kell Plantation, for use as a federal hospital. They also took over some other plantation homes in the area. The Hermione House is one of only four antebellum structures standing in Madison Parish.
Unlike many other houses in the area, it was not destroyed by Grant during the Vicksburg Campaign because it was being used as a Union hospital. The one-story building is now operated as a museum and offices for the Madison Historical Society, to which it was donated in 1997. Afterward, it was moved to its current location on North Mulberry Street (serving in the city as US 80).
The house was originally listed on the National Register of Historic Places on October 17, 1988, at its former location on the Kell plantation. After the building was successfully moved and adapted for use by the historical society, it was relisted on November 23, 1998. It is located at 305 N. Mulberry Street (also serving as US 80).[1]