Okay, yeah, if he struggles that much on a literal minigame where you literally just wait for the fish to hit the green zone, then click, that is an actual skill issue by this point.
Honestly, it's really surprising how he even got that far. You cannot forget about Yui's quick time events. Like, he could do THAT, yet the fishing minigame is "too fast" for his reflexes? My brother in christ, are your eyes connected to your brain through Bluetooth?