We just tested recording some clips with OBS on Windows 11, both windowed and fullscreen and it seems to be working with our hardware.
We'll try to test with other configurations, but in the meanwhile if you haven't already, you should try updating your video drivers, it tends to help ^^