Really fun concept. Maybe tailor the dice to the level, so when there's no boxes or switches in the room, those actions don't appear on the dice. And it might be less frustrating if the turns were always in the same direction, but the number of times you turn varied by roll - then just make those rolls 1 or 2.