Really great idea and the way in which you use it is even better.
IMO, a more dynamic player controller would make the game much better.
Thank you so muctch for the feedback! I wanted to make the player controller as simple as posible to focus the experience around the mechanic of swapping dimensions, thats why I made it what way :)