We're aware of this bug, and I'm sorry to hear this happened to you :( I would recommend just press A as little as possible during the game. If you need to heal, you can also press spacebar to avoid this.
We're planning on making a post-jam version that addresses this issue and some others, as well as some balancing (maybe new features too???). We'll look into the UI issue as well, thanks for pointing that out.
Thanks for the feedback and glad you enjoyed it despite the bugs!