Really interesting concept with potential. There really needs to be an indication as to how things have moved and some way for the player to more easily remember the layout of the level.
