One suggestion I have that would most likely heavily simplify your code is to just simply rotate the camera, instead of everything within the room, but I'm not sure how you're doing it already so your way could be simpler.
Oh, that's a cool idea! The code isn't too complicated at the moment. I think the issue lies more in some collision shenanigans. Either way at some point I'll make the whole project public on github if anyone wants to check it out.
