You might want to consider having the music stop with a missed note. That's a big part of the enjoyment of rhythm games.