After studying law, he was admitted to the bar in 1867 and commenced practice in Marengo in Iowa County.[1] In 1866 he married Addie M. Whiteling, who died in 1870.[1] His second wife was Mary H. Shepard.[1]
In 1873 he was elected to the Iowa Senate, where he served until 1878. He served as member of the Board of Regents of the University of Iowa from 1880 to 1886, and as curator of the State Historical Society of Iowa from 1881 to 1885.[1]
In Marengo, he served as a city council member, as mayor (from 1885 to 1886), and as city attorney (from 1896 to 1900).[1] He also served as member of the local school board.
In 1900, Rumple was elected as a Republican to the U.S. House seat for Iowa's 2nd congressional district. He served in the Fifty-seventh Congress, but became seriously ill before the completion of his term. His illness prevented him from seeking re-election in 1902.[2] Suffering from a cancerous tumor in his neck,[3] he died on January 31, 1903, while hospitalized in Chicago, Illinois. He was interred in the Odd Fellows Cemetery in Marengo.