Yeah, that seems to be a major issue unfortunately. I wish I could update the game and fix it, but that's not allowed during the jam. A good lesson for my future first person games I guess.