The general consensus is:
You have a higher skill-level than an average player.
Viewing post in One Button Adventure jam comments
Yes. Playtesting your own games raises your skill level. Therefore, you generally want to make it harder for yourself and tend to forget that you're releasing to people who haven't reached your level yet. I initially made that mistake before releasing my first game on itch.io.
I personally have no advice to give you here. Nothing's intrinsically wrong with your game anyway (especially with the Jam's constraints). The fact that you test it shows that it can be done. It's just a call for players to get better at it.