Maybe only drop bullets if player killed enemy by sword after fixed amount of kills? Something like drop 5 bullets after 4 sword kills.
Also I don't see how bossfights are too hard. I think they were fine. I always could kill boss after 5 tries at max.