The storm section could include some other challenges not only getting to the port, at least that's what I did, I always went at 1 PM to the port and started the next day.
There's actually a few fishes you can only get while fishing in the storm :-) While going to the port is the safest option, you can save up some money to try to endure the storm and repair your boat to get those rare species ! :)