Thank you for your feedback!
That was actually one thing I tested it during development. In the end, in order to keep the game as simple as possible I decided to keep it this way.
But that is something that could added as an option in a later update.