The town's origins dates to an administrative division of the island made by English colonists in the late 17th century, after they took over New Netherland from the Dutch in 1664. The town was incorporated as one of the four original divisions of Richmond County in 1788.[2] In 1860, Middletown was created from parts of Southfield and Castleton.[3][4]Fort Wadsworth is located in Southfield.