I totally agree with you.
A big idea of the game is the progression system, that is colour and upbeat audio returning to the character's base, being a metaphor for one's mental state.
The fishing task / minigame was kinda shoehorned in for the sake of a having a challenge for the player and actually gamifying the experience. The team definitely expressed that was something to be improved upon; original idea was to have multiple things for the player to do, but as jams usually go, we minimized our scope.
Appreciate the thorough feedback :)