Born in Minneapolis, Swift's father owned a factory that made sausage casings. After the depression, he dropped out of school at the age of 17 and boarded a freight train to California to pursue his goal of working for Walt Disney. After arriving in Los Angeles, Swift worked several odd jobs to earn money including working as an usher at the Warner Bros. theatre. In between work, he attended art school and also attended Hollywood High School at night.[1] He began his career at The Walt Disney Studio as an office boy and rose to be an assistant animator under Ward Kimball in 1938.[2]
In 1951, Swift married actress Maggie McNamara.[3] They later divorced.[4] He married model Micheline Swift in 1957 to whom he remained married until his death. The couple had two daughters, Michelle and Wendon.[1]