Large buttons can only be activated by a large player, and small buttons can only be activated by a small player. If the large version of the player cannot activate the button, try moving shortly after pressing it.