I think I found the culprit!
When you mentioned how CMB is usually scroll, I remembered I use an extension that changes scroll behavior to be more like dragging on a touchscreen. Disabling it allows the button work normally.
I'll make sure I put an exception for this page.