Phillips was born in Shoreditch, London. At club level, he played his entire professional career for Portsmouth,[2] and was a member of the championship-winning teams of 1949 and 1950.
After his professional career, Phillips went on to play non-league football for Poole Town, Chelmsford City, Bath City and Waterlooville, the latter while working as a lathe operator at De Havilland's works in Portsmouth.[3] He made his last appearance in senior football at the age of 44, in a 3–0 win for Waterlooville against Andover on 24 September 1966. After that, Phillips appeared for several years in occasional charity matches for the Pompey ex-Professionals team.