From my testing with VR videos, the Nvidia RTX 3080 (10GB VRAM) can barely handle 5K (ex. around 5100x2550). Anything higher crashes due to running out of VRAM. Note that I had to set Data Precision to Above Normal. Data Precision Normal led to unacceptable artifacts.
I tried the "save memory" option but it didn't seem to help much.