1 thing i've noticed through-out all my runs, is that it always seems to be that on the 1st Hunt, you either you have no trouble beating the boss, or you'd lose even if you chose to skip. So i find it rare to get a build with the power to lose to the boss, but still beat the enemies if you skip, and since theres no extra risk to the boss fight other than the difficulty, then i see no reason to skip it.