It was the band's first album not to feature bassist Jennifer Condos, and showed a major departure from their former style. Instead, they now incorporated the use of synthesizermoog pedals, giving the music a much stronger pop-rock sound. In addition, they recruited the assistance of several female backing vocalists on most songs, instead of relying on the other band members to back up Tito Larriva's vocals. This musical element is something the band also featured on their next album, 2002's Andalucia, which featured bassist Io Perry singing backing vocals on almost every song. The rest of the new elements featured on Little Bitch were mostly abandoned on Andalucia, which returned a sound more similar to that featured on the band's second album, 1999's Hungry Sally & Other Killer Lullabies.
The album also contained songs written by new songwriters. Charlie Midnight, who had co-written Tito & Tarantula's 1995 hit song "Back to the House (That Love Built)", co-wrote the music for "Everybody Needs". Larriva's former Cruzados bandmate, Steven Hufsteter, co-wrote "Crime & Shame", "World at My Feet" and "Super Vita Jane"; and ended up joining the band as a second lead guitarist. The music for "Dead Person" was co-written byDominique Davalos, who later became the band's bassist in 2005, and played on the album as a session musician, as the band chose not to hire a replacement for Condos to play on the album.