During this early period, Borden was one of the few African-American players on the Packers along with Frank Purnell, who played in 1957. When he could not find housing within the city limits, he had to room at a rundown motel just outside Green Bay. A number of Packers were also staying at the motel. They told the manager he would lose their business if Borden could not room there. Quarterback Bart Starr befriended Borden and frequently had him and his family at Starr's home for dinner.
He was a starter at defensive end during four straight seasons. When Vince Lombardi was hired as the new head coach for the 1959 season, Borden was the only African-American player on the roster and Lombardi had to assist him in finding a decent place to live. He wasn't protected for the NFL Expansion Draft due to a knee injury.
In 1962, he was signed by the Buffalo Bills of the American Football League. He played in three games before an ankle injury sidelined him for the rest of the season. He was cut in 1963.
After finishing his scouting years, Borden became the assistant to the mayor of Jersey City, Jim Sutcliffe. After Sutcliffe lost a bid for re-election, Borden moved to Las Vegas, where he was assistant to the mayor Russ Dorn. He was also the Officer of Urban Development in the city of Las Vegas.
Borden died of cancer in Las Vegas on September 30, 1992. He left behind two sons and a daughter.