This seems to be an issue with Unity + OpenXR + Nvidia drivers = terrible performance. I have the same issue on my development PC, running as a standalone exe or in Unity. The game isn't very demanding and it used to run perfectly fine so I'm at a loss. I think it may have something to do with either Windows Game Bar or Nvidia's overlay stuff. Hopefully I can fix it soon as its preventing me from putting it on Steam