Really well polished, and cute, but, as you've mentioned, the difficulty does ramp up a bit too steeply.
I believe I have it sorted now. The keys increase every 2 rounds, longer time limit for the fishing phase, and instead of real-time reading the keys, I have made a key queue so no false fails! Thanks for playing!