Man, this it tough! I think it would be really helpful if there was some warning of when the controls will change, otherwise it's a bit frustrating. I like the idea of the controls swaps, but they don't need to be that surprising haha
As you mentioned in the discord server it was hard to see what you were doing in development, similarly it's hard to see what's happening while playing! Not impossible obviously, but I think more contrast would feel/look nicer.
Well done though :)