I feel like this is the sort of concept that is very open to having a lot of interesting difficulty modifiers that continually stack on top of each other, like having two keys at once or having to press the buttons to a rhythm.
Then you could swap out the modifiers and continually mix and match as a run progresses.