Thanks for feedback. I decided a bit different thing. Now + and - for switching channels have their own cooldowns. So you can switch to other channel and then switch back immediately. Also I added Pause (Esc or Q) and you actually can switch channels right during the pause.
I understand that this mechanic can be a little complex, so now I'm working on sort of tutorial (plus changing levels to be more interesting in general).