I like the idea a lot. Its a really interesting game mechanic and I think that it could be a really successful puzzle game!