A major fire started in the town in the 1930s and due to the Great Depression, many of the businesses and homes destroyed by the fire were too costly to rebuild. The fire, along with the Depression hurt the town greatly and it started to decline in population, with people packing up what they could carry and abandoning their homes that they could no longer afford to keep and maintain.
In November 1966, residents of Elberton voted 15–5 in favor of dis-incorporation.[3] Elberton became part of unincorporated Whitman County, Washington again within four years, when the county acquired the property of the town. As of 2005[update], Eleberton is the last instance of a municipality in Washington voting to disincorporate.[4]
Currently, about 15 people live in the 200-acre (0.81 km2) area that once was Elberton.[4] Many of the original homes and buildings have gone or are partially collapsed. Remaining landmarks include United Brethren Church (built in 1913) and the Elberton Cemetery.[5]