In 2001, David Guetta along with Joachim Garraud founded Gum Productions, and in the same year Guetta's first hit single, "Just a Little More Love", featuring American singer Chris Willis was released. Willis was vacationing in France when he met Guetta. Guetta's debut album Just a Little More Love was released in 2002 on Virgin Records and sold over 300,000 copies. The follow-up singles, ("Love Don't Let Me Go", "People Come People Go" and "Give Me Something"), were released in 2002. Guetta released a compilation, Fuck Me I'm Famous, in 2003, named after his party in Ibiza. It included "Just for One Day (Heroes)", a remix of David Bowie's song "Heroes". Later in his career, Guetta continued recording compilations under that title.
Guetta's second album, Guetta Blaster, was released in 2004. It released four singles: "Money" and "Stay" featuring Chris Willis and "The World Is Mine" and "In Love With Myself" featuring JD Davis. In 2006 the Just a Little More Love single "Love Don't Let Me Go" was re-released as a mash-up with the Tocadisco remix of "Walking Away" by The Egg. The mash-up single entitled "Love Don't Let Me Go (Walking Away)" was charted higher than the original release of the song.