Pictured: Me possessing a bullet when I started my second playthrough. My bullet type didn't restart either (but that might just be a visual bug).
I just had the same thing. I let myself die on the dummy just to see and the reload did that.