Small was elected as a Republican to the Forty-third Congress (March 4, 1873 – March 3, 1875). He was not a candidate for renomination in 1874. He resumed the practice of law and also engaged in banking. He died in Newmarket, New Hampshire, April 7, 1878, and was interred in Riverside Cemetery.