Anderson was born in Zionsville, Indiana. He graduated from Wabash College in 1883, receiving his master's degree (A.M.) in 1887.[4] Anderson worked with Andrew Carnegie to create the Carnegie Library in Pittsburgh, Pennsylvania in 1895,[5] and served as the director of that library until 1904, when he stepped down because he could not afford to support his family on the salary.[6] After a two-year stint (1906–08) as the head of the New York State Library and Library School, Anderson became the director of the New York Public Library in 1909, a position he held until 1934.[7]
As a library leader, Anderson was best remembered for the librarian education programs he established in both Pittsburgh[8] and New York City.[9]
Anderson was married, with at least two children, daughters Charlotte[10] and Cecile.[11] He died in Evanston, Illinois.[12]