To start, it's a really interesting premise and I like it a lot. With that said, I think it will be pretty difficult to pull it off. Your current implementation may be a bit too disorienting... I may just not be smart (or patient) enough to crack the puzzle though 😉