Thank you for your constructive feedback. We really appreciate that! We didn't have much chance to do enough playtesting, so we missed these kind of things. :)
You are right we don't want to stress the player out too much. We will reconsider that for future updates.
I hope you enjoyed the game regardless this issue!