Perkins was elected as a Republican to the Forty-eighth and to the three succeeding Congresses, serving from March 4, 1883 – March 3, 1891. He was an unsuccessful candidate for reelection in 1890 to the Fifty-second Congress, but was appointed to the U.S. Senate to fill the vacancy caused by the death of Preston B. Plumb, and served from January 1, 1892, to March 3, 1893, when a successor was elected and qualified. He resumed the practice of his profession in Washington, D.C., and died there in 1894; interment was in Rock Creek Cemetery.