Connie Smith had a series of major hits for RCA Victor Records in the late 1960s and early 1970s. However, Smith left the label in 1973 and signed with Columbia Records, which she recorded for until signing with Monument Records.[2] Under the production of Ray Baker, she recorded several singles releases for Monument in the late 1970s, including "Lovin' You Baby". The track was composed by Troy Seals and Jo Ann Campbell Seals. The song was recorded in January 1978 at the Columbia Studio, located in Nashville, Tennessee. With Baker serving as producer, Smith cut an additional three tracks during the same session.[3]
"Lovin' You Baby" was issued as a single on Monument Records in February 1978. It was backed on the flip side by "All of a Sudden," on a vinyl-issued single.[3] The song spent ten weeks on the BillboardHot Country Songs chart and peaked at number 34 in November 1975.[4] It was Smith's final single in her career to reach a peak position in the country top 40.[5] It was later issued on Smith's 1978 album titled New Horizons.[1]