I like your glowing art style, and I also liked how the pattern appears in beat with the music.
This game was more frustrating than fun. Sometimes the control is an illusion would happen too frequently, that by the time I figured out what had changed, I was already losing control. On the GYBMRC level, before I was even able to fully view the pattern, I lost control.
I really think that the portal should just stay open once it fills the bar up. I actually like that bar, its a very clever mechanic that works well with your current functionality. But having it fill up, open the portal, start making my way to it, just to lose control, and have the buttons change and the portal close is so frustrating.
I think what makes this game more frustrating is that the player can't work with not having control. Some of the best games of the jams will take control away from you, but in a way that you can work with or around it. This game, felt more like I was fighting it, and working against it. My favorite moments with this game is when the adversary would turn on buttons that I needed. That made me realize that what I think I want is a way to use losing control to my advantage.
My idea right now is being able to see what colors they will change buttons to, so maybe you'd have to strategically position yourself by the correct buttons to make them work with you. Just an idea, and it might take away from the whole "figure out what they did", but as of right now, the game is more frustrating than fun.
I also encountered an annoying oddity. On the GYBMRC level, I'd have the portal open, and make it in just as the clock hit like 1 second, or I lose control, and it'd show the "Progress is an illusion" and then restart the level, so I assumed I had lost. Twice. Maybe that's intentional, but it was not clear.