Absolutely brilliant, but there's a bug where the inputs get flipped when going to the next level.right = 1, next level, need right = 0 to go right, and right = 1 means go straight.
Never thought of using latency as a game mechanic, that's awesome.