The Col. Joseph Ellis House derives primary significance as the residence of Joseph Ellis (d. 1796), a political officeholder and important commander of local militia during the American Revolution. Born in Ellisburg, Gloucester (now Camden) County, Ellis married Mary, daughter of Jacob Hinchman, in 1760. The couple lived in this house.[3]
The house stands on land that belonged to John Hinchman, Sr., then, after his death, to Jacob Hinchman his youngest son.[3]