Attempting to separate themselves from the new millennium surge of post-punk bands, the ladies of the Organ came together in 2001 to design their own original modern sound. Katie Sketch (vocals), Deb Cohen (guitar), Jenny Smyth (organ), Shelby Stocks (drums), and Ashley Webber (bass) hail from Vancouver, and each has an appreciation for bands such as the Cure and the Smiths. In summer 2002, the Organ introduced their dark style with the release of the Sinking Hearts EP. The Canadian press and indie publications across America praised the Organ's dream pop-inflected presentation. By January, the Organ signed to Chad Kroeger's 604 imprint and Mint Records. Plans for a full-length album got on their way almost immediately, with the Organ asking producer/New Pornographers drummer Kurt Dahle to produce the CD. Unfortunately, those sessions proved difficult, forcing the Organ to scrap the material and start over. Producer Paul Forgues soon jumped on board to complete Grab That Gun, which arrived in spring 2004.