The key is in the bottom right corner of the fishing minigame. You'll need the upgraded boat to get it.