Really neat idea and I really like the art style. It can be a bit frustrating at times, but I suppose that plays into the "out of control" theme which I can appreciate. I think if there was maybe a more concrete reason for the controls to change instead of it being random it may improve the gameplay and be less frustrating. Say the player has to walk over a button that changes the controls, something in game that gives the control switching some more meaning and makes it a bit less random.
Overall really nice work!