A really interesting mechanic here! Totally understand the overscoping problem but hope you come back to this for more levels because there's definitely room for more puzzles. I was also amused that I could die in the game over screen :)
Is this the controller you were using? https://assetstore.unity.com/packages/tools/physics/kinematic-character-controll... Movement was very smooth, so I'm genuinely interested for future projects.