Thank you for finishing the game and giving us feedback!
We discussed this a lot with our team over the past few days actually and came up to the conclusion that it is probably this difficult because there are 2 buttons that basically perform the same action and that's something that's very hard for the brain to process. So as much as it looked cool on paper to have 2 kinds of blocks to disable and can be fun, it is very easy to confuse the buttons and can lead to frustration or a feeling of disconnect.
Anyway, thank you!