Hold L + R and turn on the Game Boy Advance. Select "Yes" at the prompt to delete your game saves.