After the split of Pretty Girls Make Graves in early 2007, former member Derek Fudesco (guitar, bass pedals) recruited Pete Quirk (vocals, guitar, harmonica) of Hint Hint and Marty Lund (drums, guitar) of Cobra High and formed The Cave Singers. Months later, the band's debut album "Invitation Songs" was released on Matador Records. Inspired by Bob Dylan and Willy Nelson, the album received much critical acclaim for its hypnotising folk-rock - a far cry from the indie style of PGMG. The album's success led to appearances at several festivals in 2008, including Glastonbury, Zomerparkfest (Holland), Greenman (Wales) and several festivals in America.
