I have similar issue. It looks the issue is in PyTorch itself.
In my case I have out of memory at 90% of progress (4x interpolation of 1440p video, 4000 original frames). And after several tries of resume and increasing pagefile (I am at Windows 10) to 10GB, then to 15GB, then to 28GB, interpolation was finished.
I am not sure if pagefile helps, but you can try.