Cool idea and the mechanic works well.
I would have liked some sort of visual queue when switching, maybe a short animation. Now only the camera jumps.