Ah, the four torches were a separate puzzle from the golems. That idea with the golem room was that one of the six little golem "cages" had a torch you needed to light, and to circumvent fighting up to six golems to see which room was the key forward, you could scout through the doors in spirit form to avoid opening them at all.
The next puzzle with the four torches being so close to the golem one is admittedly misleading and could've been pushed a bit further away.
The sixth pressure plate was indeed kinda buggy after taking another look at it, so thanks for pointing it out.
Thanks for your comments :)