Cool concept! It's simple to grasp, but the combinatoric makes it quite difficult.
For activating the switches, I'd prefer to be able to do that no matter which direction the character is facing. As it is, you need to stand besides the switch and face it to be able to trigger it.