There are two kinds of buttons, the ones without a brim will stay down once stepped on. I should make them more distinct I see, thanks for the comment. The level can be beaten! You can restart it from the menu in the bottom right or by pressing R.
EDIT: Updated the game. Both kinds of buttons are very different from one another now.