The house probably served as a meeting place for legislators during the time Poughkeepsie was capital of New York in 1777.
Clinton House was built around 1765 by Clear Everitt, who was sheriff of the county from 1754 to 1761, on land that had belonged to Hugh van Kleeck (born about 1745, died after 1810) who owned about 20 hectares of land south of Main Street where the house stands. (The Van Kleeck House built in 1702 was demolished in 1836.)[3] In 1780, the house was purchased by Udney Hay, who belonged to Quartermaster Corp of the Continental Army. In 1783, the house was destroyed by fire and Hay rented the nearby Glebe House. When his house was damaged by fire, Hay petitioned George Washington for craftsmen from the army to assist in its repair.[4] However, Hay lost the house in 1786 when it was seized for debt.
Today, the Clinton house is used for the offices and library of the Dutchess County Historical Society, with one room still set aside for use by the Mahwenawasigh Chapter of the Daughters of the American Revolution.[5]