Doughton was one of twelve children of J.H. and Rebecca Doughton of Laurel Springs, North Carolina. All twelve went to college. Rufus attended the University of North Carolina at Chapel Hill.
Doughton was later elected to the state House again, serving in the 1909, 1911, and 1913 sessions.[3] He also served as secretary of the North Carolina Department of Revenue for several periods.[4]
Personal life
Doughton's family home is now a bed and breakfast called Doughton Hall. His brother, Robert L. Doughton, served in the U.S. House of Representatives for many years (1911–1953) and helped write the Social Security Act. Robert chaired the House Ways and Means Committee for many years, longer than any other congressman. A book called Hillbilly Women includes a story of a poor woman whose family needed money to bury a relative and walked over the ridge to ask "Rufe Doughton" for help.
Doughton and his wife, Sue Parks, had two children. His son, James Kemp Doughton, also served in the state legislature and as speaker of the House.