I just tried it again, the block puzzle was great! I was 'stuck' with the exit from the yellow level in the floor and the blue level npc on the right-hand wall. I thought I couldn't get back into the yellow level after leaving it because I kept walking over the gap. Turns out I was mistaken and just didn't try hard enough so I was able to go back and reset the orientation.