I think your idea is interesting, but there are some colliders that are not working correctly and when you quit to the menu and go back to the game, there is a bug that forces you to press esc in order to be able to move
Keep on the good work!