I switched to FXAA and it helped a little but shadows seem to be the most impactful thing so far, although I didn't notice any visual difference between medium and high. When I was disabling them during the stream it produced much less difference than off-line, but I guess this is something I have to figure out myself. I tried using the build shaders option but it didn't seem to do much. Dynamic resolution settings gives me no performance difference whatsoever, not sure how is it handled.
Is there any chance for FSR3 support (upscaling, don't really care about the frame generation) in the future? I used it while playing Ghost of Tsushima and it was very beneficial, could grant better results than the current scaling system.