I had a strict rule to only introduce new stuff every 3rd level and focus the 2 in between on the new mechanic.
So for most of the levels I had some idea what to do. The rest was "do a thing some time, place an obstacle, do another thing, now place the goal". I'm amazed at how good that worked.