Upon graduation from Penn State, Harlow remained with the Nittany Lions as an assistant football coach for three seasons, under his former coach Bill Hollenback. Harlow succeeded him as head coach in 1915, and hired Lawrence Whitney as an assistant. After compiling a combined 20–8 record in three seasons, Harlow entered the United States Army in 1918, and was stationed at Virginia Polytechnic Institute and State University, where he was an assistant coach for Charles A. Bernier. After an honorable discharge, Harlow returned to Penn State in the following year, again as an assistant, but this time under coach Hugo Bezdek. Harlow also became the boxing coach at that time.[1]
Colgate
Harlow left Penn State to become the 20th head coach at Colgate University from 1922 to 1925, succeeding Ellery Huntington Jr. For the first two seasons, Harlow hired Punk Berryman as assistant. Harlow coached the team to a 55–0 victory over Niagara University, where players refused to tackle any Colgate players, leading to many scores.[2] Harlow's overall coaching record at Colgate was 24–9–3.
Western Maryland
Harlow moved from Colgate to become the head coach at Western Maryland College from 1926 to 1934, succeeding Ken Shroyer.[3] There, Harlow coached the Green Terror to a 60–13–7 record with three undefeated seasons.[4][5] In 1934 Western Maryland was invited to play in the inguinal Orange Bowl. Seeing it as not much of a challenge; Harlow declined to have his players play in then more prestigious East–West Shrine Game. In Orange Bowl, Bucknell, who lost to the Green Terror early that season, beat the Miami Hurricanes.[6]
Harlow had many great players such as Eugene "Stoney" Willis, who threw the first shovel pass against Boston College in 1932, and Bill Shepherd, who was considered to be one of the best running backs in the country in the early 1930s, starring the East West shrine game in 1934 behind Michigan center Gerald Ford. At Western Maryland, Harlow also coached Rip Engle. He had a great influence on Engle's career, and they remained good friends for many years. Harlow said that his "biggest thrill" came from those games where he beat Bosten College and Bucknell by such a lopsided margin.[6]
Harvard
In 1935, Harlow became the first non-alumnus ever to coach at Harvard. The job was initially offered to Clark Shaughnessy, but was turned down. Harlow's assistant coaches immediately became Henry Lamar and Skip Stahley. Lamar took over as head coach while Harlow served in the United States Navy during World War II. When Harlow returned, Lamar went back to being an assistant. From 1938 to 1946, Lyal Clark also served as an assistant. At Harvard, Harlow was voted Coach of the Year in 1936, and a year later, was chosen as the Ivy League Coach of the Year. He retired in 1947 with a lifetime record of 149–69–17, and was succeeded by Arthur Valpey. Harlow was named to the College Football Hall of Fame in 1954.
Oology career
Harlow was an expert in oology, the study of birds' eggs. In 1939, he was named curator of oology at the Harvard's Museum of Comparative Zoology, and he remained in that position until 1954.