A native of Boaz, Alabama, Milwee initially walked-on at Alabama in 2004, redshirting the season as a reserve quarterback.[1] He then transferred to then-Division IINorth Alabama to play for head coach Mark Hudspeth. After spending the 2005 season as a backup quarterback, Milwee was named the starting quarterback in 2006 where he compiled a 33–5 record and broke several program records including passing yards, completions, and passing touchdowns.[2] He was also a two-time finalist for the Harlon Hill Trophy, an award given to the top college football player in Division II football.[3]
Milwee was named the quarterbacks coach at Akron in 2012, working once again under Terry Bowden. He was promoted to offensive coordinator in 2013 at the age of 26, the 2nd youngest coordinator in FBS at the time of his hiring.[5] He was not retained after the firing of Bowden in 2018 and was replaced by Tommy Zagorski.
Alabama
Milwee was hired as an offensive analyst at Alabama.[6] He was later hired to be the offensive coordinator at Arkansas State under former Alabama analyst Butch Jones before accepting a position at Texas.[7]
Texas
Milwee was hired away from Arkansas State as the quarterbacks coach at Texas under former Alabama offensive coordinator Steve Sarkisian.[8]