In his book History of the Christian Church, Bishop Hurst stated that the early Christians "would have looked with horror" at the suggestion of having images in places of worship. Today, Christians, would follow the pattern set by the first-century Christians : Do not pray to images of "saints" or angels; do not even pray to Jesus. And do not perform acts of worship to symbols of the State. Come what may, we are determined to obey Jesus’ words: "It is The Lord your God you must worship."—Matt. 4:10.
As bishop, he was assigned to Des Moines, Iowa. He subsequently served as the first chancellor of the American University (Methodist Episcopal) in Washington, D.C., where through his work finances were secured and the university opened. He served as chancellor from 1891 until his death on May 4, 1903, in Bethesda, Maryland.
Legacy
On the campus of American University, there is an academic building named after Hurst.
Hagenbach's Church History of the Eighteenth and Nineteenth Centuries (2 vols., 1869), a translation
van Oosterzee's John's Gospel: Apologetical Lectures (1869), a translation
Lange's Commentary on the Epistle to the Romans (1869), a translation with additions
Martyrs to the Tract Cause: A Contribution to the History of the Reformation (1872), a translation and revision of Thelemann's Märtyrer der Traktatsache (1864)
Outlines of Bible History (1873)
Outlines of Church History (1874)
Life and Literature in the Fatherland: the Story of a Five Years' Residence in Germany (1875), sketches of Germany
Our Theological Century (1877), a brief pamphlet
Bibliotheca Theologica (1883), a compilation by his students, revised by G. W. Gillmore in 1895 under the title Literature of Theology