I liked the visuals and music, it's all very cute. The hats are a nice touch.

The background being plain and the only indication that we're moving being the coordinates feels confusing. The first time I played I went to the right for 30 seconds without encountering anything, wondering if I should quit the game. You should probably either make the game world smaller or increase the chances of finding something. Other than that, variety in the scenery would help give the urge to explore more. 
I didn't really understand why the gardens were despawning after a few seconds when I reached them (is it a bug? are the enemies destroying them? do they disappear once you collect all resources?), that and the randomness+scarcity of encounters kept me from really having fun. 
At some times my character would move in one direction on its own.
Finally, writing the character controls in the game description would be nice.