This almost looked like an intentionally frustrating game - like Getting Over It or something - until I figured out you could use D to move away from the wall-o-doom (along with the clunky jump, morose score, and "washed out"/colourless visuals)
I would say - keep those. And then let the player erase the goal post completely to access different/secret parts. Maybe repeat a level several times to give the player more of a sense of discontinuity/incongruity to clue them in to deleting the goalpost.
And you'll have a very trippy game