This error means you ran out of vram while generating/loading the model. So try closing out of other windows or try loading a smaller model like openmusenet-M or openmusenet-s
These messages are intentional, currently, there is no way to run the larger models with your gpu. The amount of notes the ai generates is automatically set to the max so it is not possible to generate more than the max