Carroll attended Warren G. Harding High School in Warren, Ohio. In his junior year he made the first team, All-Ohio UPI defensive team as a defensive end.[2] After graduating, he went to Pitt, where he played linebacker, and was a starter as a sophomore.[3] However he was injured in mid-October during the Navy game and missed the remainder of the season.[4] The following year he was back in the starting line-up and considered one of the top defensive prospects in the country.[5] During the 1972 NFL draft, Carroll was selected in the 11th round by the Oakland Raiders, the 277th pick in the draft. He was the only college player from Pennsylvania picked in the draft.[6] After beginning the 1974 season with the Raiders, he was cut in September, as they pared their roster back to 47.[7]