In 2008, Kevin Morby of Woods and Cassie Ramone of the Vivian Girls shared a small apartment in Clinton Hill, Brooklyn for a few months and wrote some songs. After meeting again in a house party, the two decided to start a band.[2][3] The idea was to recapture the early, stress-free days of playing music before they were both in groups that had gained some success and created accompanying pressures. Despite the intention, nothing much came of the idea until the next winter when both bands again had a break. Justin Sullivan, who had played with Ramone in Bossy, began practicing with them on drums, and The Babies debuted as a three-piece in March 2009 at Dead Herring, their friends’ loft in Brooklyn.[4][5] They played a few times before asking Nathanial Stark, formerly of Bent Outta Shape, to join on bass, and the full lineup’s first shows were in that summer.
The band released self-made tapes and singles for the small Wild World and Make a Mess labels before releasing their self-titled debut album for Shrimper in February 2011.[6] They toured for much of the year, eventually replacing Stark with new bassist, Brian Schleyer.[7] In early 2012, they left their Brooklyn home to record their second album in Los Angeles.[7]Our House on the Hill was released on Woodsist late in the year.[6]
In 2014, Cassie Ramone stated that the band was going to be "largely inactive" due to her focus on her own, as well as Morby's, solo careers.[8]