The town was built from land purchased from the former Esmont plantation estate, built by Dr. Charles Cocke, and for which the town was named. Having rich soil, the town has historically been a farming community with a predominantly African American population. The area has been populated since the eighteenth century, though it did not acquire a post office until the later nineteenth century.[3]
Slate quarrying began near Esmont in 1883, and by the mid 1920s, the 6000 acre was the nation's largest soapstone producer. The quarry operation stopped in the 1960s due to environmental concerns. At its peak, Esmont had a depot for the Chesapeake and Ohio Railway, 3 stores, St. Steven's Episcopal Church (built of wood in 1914 and still in operation) and a bank (now converted into a post office). It has recently been the focus of an oral history project by the Carter Woodson institute.[4]
New Hope Baptist is a historically Black church in Esmont. In 1974, the pastor was Rev. H. J. Scruggs, Jr.[5]
In 1974, Esmont also boasted a Greencroft Garden Club.[5]