Jim began his racing career in 1945 at the age of 17. He raced stock cars in Dallas, Texas. Jim would race in the local Texas bullrings for the next fifteen years while working as a bricklayer. It was in 1960 when he and fellow Texan racer Johnny Rutherford decided to race in the Midwest. Both would eventually find super modified rides in the International Motor Contest Association (IMCA). Jim did well enough that by late-summer 1961 that he was offered a ride by fame car owner Lindsey Hopkins in the Hoosier Hundred, a race at the Indiana State Fairgrounds on the United States Auto Club (USAC) National Championship Trail. He finished third in this race, an impressive start to his Indy Car career.
He raced in the 1961–1983 seasons, with 178 combined career starts, including 15 in the Indianapolis 500 in 1962–1970, 1973–1974, and 1977–1980. He finished 48 times in the top 5, with five victories. He was runner-up in the 1966 championship and third in 1963, 1965, and 1970. In 1962 he was named Indianapolis 500 Rookie of the Year, a result of his 6th-place finish.[4]
Jim won the inaugural California 500 at Ontario, California on September 6, 1970, driving A.J. Foyt's team car. He battled with Art Pollard for the last 10 laps after Al Unser and Cale Yarborough retired with mechanical issues.[citation needed]
Jim's son, James Jr., was killed in a sprint car crash at Winchester in October 1977. James Jr. had attempted to qualify for the 1977 Indy 500 earlier that year. Alongside his father, they were attempting to become the first father and son combination to qualify for the same race. However, James Jr. was too slow to make the field.[6]
Jim's daughter, Shirley, married racing driver Tony Bettenhausen Jr. The couple died when their private plane crashed in Kentucky in February 2000.