I think, not only pressing the right button at the right time, but als switching to the correct lane is a great idea. But I agree with wChi: Switching lines with left and right would work much better for the game.
Maybe for hardcore-rhythm-game-players your control choise is more interesting. But game jam games shouldn't have a too high difficulty level, to be als attrative to player that are not so much into a particular genre.
Apart from that, you made a good job. The art work is good, the music great, the gameplay fun. Keep up the good work.