Just gave the boss another go. I didn't actually have to go back and retrieve any upgrades; once I figured out that the bullets were homing in on me, I found jumping to manipulate their paths was my best bet for dodging.
Finally managed to beat the dude!