Nice little game.
As you say yourself, the controls are really messy, sorry to say. It was kinda hard to interract with man in the beginning, and perhaps a little story that the player could choose to read, about why we are in the forst and why we are even helping that shady man, when we don't know what the reward is, would be a great addition :)
But overall nice game, you have some lovely pixelart and the music fits well with the game!