Sorry I didn't make this clear in game (I am too lazy to make a tutorial) but you can select the fishing pole along with your lantern by using the mouse wheel. Fish coins can be earned by fishing at the nearby lake, the ones you pick up in the world are just a bonus :^)
