While touring Spain with The Apples in Stereo, Schneider was inspired to write "Push You Away", the first song written for 010. Schneider began writing other songs for the album as well.
In Lexington, Kentucky, the band formed by impulse when Schneider invited Ferguson and Fulton to organize songs for Schneider's other side project, Marbles. Schneider asked them to first play his set of 10 songs, and Ulysses was born. The band recorded the album 010 live in Schneider's garage studio, in mono with the drums and amplifiers situated symmetrically around a single microphone. The album was released on Eenie Meenie Records.
In the process of writing and recording 010, Schneider's marriage with Apples in Stereo bandmate Hilarie Sidney ended.