Incredibly, I have accidentally figured it out upon reaching the sword ghost! Seems there is indeed a separation between magical and physical attacks in this game
