It sounds like you're trying to get them in with just pulls (Z key), when you reel with X (hold it). Here is a sample of intended gameplay: https://streamable.com/oot4d3
Ok I get it now. I was rapid clicking (to reel, right? I caught at least two fish this way) hence why it was nigh impossible. Maybe put (hold) next to the instruction for reel. Maybe I have the controls wrong but I was spamming the reel button.
