The album has been described by Anthony DeCurtis as "perhaps the most romantic album of Reed's career".[2] Many of the album's songs were inspired by and dedicated to Reed's girlfriend and muse at the time, Rachel Humphreys.[3][4] According to Aidan Levy, Coney Island Baby was "as much a love letter to Rachel as it was to the nostalgic Coney Island of the mind."[5]
The album's title track directly references Rachel with the line: "I'd like to send this one out to Lou and Rachel, and all the kids at P.S. 192."[6] "P.S. 192" refers to P.S. 192 – which at that time was a public school for kindergarten to 6th grade, in Brooklyn, New York City, NY, where Reed went to school before moving to Long Island, New York.[7] In 1979 Reed said "Saying 'I'm a Coney Island baby' at the end of that song is like saying I haven't backed off an inch. And don't you forget it."[8][9] It is a direct continuation of the poem "The Coach and Glory of Love", written by Reed and published in the Fall 1971 edition of The Harvard Advocate.
The album includes the song "She's My Best Friend", a version of which was originally recorded by Reed's band the Velvet Underground in 1969, and eventually released on the 1985 compilation albumVU. The 30th-anniversary re-issue of Coney Island Baby includes bonus tracks featuring Reed's Velvet Underground bandmate Doug Yule.
Reviewing for Rolling Stone in 1976, Paul Nelson wrote, "For the eight superb songs on Coney Island Baby, Reed assembled the best band he has performed with since the Velvet Underground. Michael Suchorsky's versatile, controlled drumming is especially praiseworthy, and Reed himself has even managed to rekindle his intense, individualistic guitar playing of the late Sixties. Better yet, he has shelved his recent FM-DJ vocal style in favor of confident, expressive singing. The songs themselves—as structured and melodic as any Reed has written — are timeless, terrific rock & roll, and the strength of the genre is accentuated by the simplicity and logic of crisp, tactile production (by Reed and Godfrey Diamond) and careful, resourceful arrangements which emphasize both electric and acoustic guitars and inventive background vocals."[20]
In Christgau's Record Guide: Rock Albums of the Seventies (1981), Robert Christgau said of the record, "At first it's gratifying to ascertain that he's trying harder, but very soon that old cheapjackennui begins to poke through. Oddly, though, most of the cheap stuff is near the surface—the songs sound warmer when you listen close. And not even in his most lyrical moments with the Velvets has he let his soft side show as nakedly as it does on the title cut."[13]
For the entry on Reed in Rock: The Rough Guide (1996), Roy Edroso highlighted Coney Island Baby as "the most pleasing of Reed's soft-rock albums" and said, "His sense of humour has never been better than on 'A Gift', and the title track reminds you why Jonathan Richman idolized Reed: who else would have had the nerve to try to find 'the glory of love' in the reveries of a troubled would-be high-school football player (in doo-wop style, no less)?".[21]