Yea, that also sounds like a failure to allocate memory for the CUDA Neural Network model. Try splitting the frames into sections in the "Fix OutOfMemory options" panel. If this is not the case then maybe something is wrong with your CUDA.
