Thank you so much for playing our game and leaving a comment!
You are supposed to go off beat (or at least skip one) if you drift off. That really is a bit unsatisfying. Maybe with a custom track and custom made level to that it would have been better! :)