Post by Three Eyes Software in Silverpine comments

Viewing post in Silverpine comments

Three Eyes Software5 days ago (1 edit) (+1)

Does the command prompt open and then do nothing for forever like for kuu24? Everything should set itself up automatically.

You're prompted to choose server or GPU
You choose GPU
The game tells you that both files are missing
The game downloads KoboldCPP
The game downloads the AI model
A command prompt opens and KoboldCPP loads the model, which should take 2 minutes at most depending on your drive speed

You shouldn't have to manually do anything with the .exe at all.
If the command prompt opens and then does nothing after "High priority for Windows Set...", perhaps there's a problem with this older version of KoboldCPP and the newest Nvidia drivers? I have no way of verifying this myself because I use a 1070.
Does the command prompt open and then close by itself?
Can you further describe your issue specifically?

Drakomis5 days ago (1 edit)

The command prompt does open and close by itself, but I notice at the end it provides an error "failed to load script koboldccp" or something in the MsDOS window. Anyway, I've been able to play via server, so I'll try playing GPU. It worked because I ran it as administrator so I'll try that.

Last time I tried this it failed to load the AI model entirely. Even doing the steps suggested didn't work. I don't use an NVIDIA graphics card, I have an AMD build with an RX6800 graphics card.

Drakomis5 days ago (1 edit)

So an update:

Repeated the steps, ran the program as administrator, and everything downloaded as you specified. However, like the last few times, it runs its program and at the end it displays "unhandled exception" or something and the window closes. Now I'm staring at the same screen for "failed to load AI model". I'm not even sure where to start or what to do, haha. No experience with this AI stuff.

EDIT:

Do you have a discord server or something for faster troubleshooting experience? If not, this is fine.

Three Eyes Software5 days ago(+1)

I've added a build that uses a more recent version of KoboldCPP. It might fix the issue.
If it doesn't fix it, open a command prompt inside the KoboldCPP folder like on the screenshot

Then run:

--model "full path to the model.gguf file here with one set of quotation marks" --usevulkan --gpulayers 43 --quiet --multiuser 100 --skiplauncher --highpriority

Which will show you the full error instead of closing the window when the exception happens.
Since windows doesn't seem to provide a way to capture the output of processes without redirecting it and hiding the command prompt completely, the game can't display the actual error by itself.

Drakomis5 days ago

This is the error I get when I copy and paste your command in. Additionally, no, the recent update didn't help. It appears to be the same error I pasted earlier with an unhandled exception. I'm curious as to if windows is blocking this program from running somehow.

Three Eyes Software5 days ago(+1)

Oops, I forgot the koboldcpp.exe before the arguments, but yes, you already posted the error. There's a single search result which turned out to be blasbatchsize related, but blasbatchsize defaults to 512 for Vulkan which isn't a problem.

You can try this which uses OpenCL instead of Vulkan:

koboldcpp.exe --model "full path to the model.gguf file here with one set of quotation marks" --useclblast 0 0 --gpulayers 43 --quiet --multiuser 100 --skiplauncher --highpriority

Otherwise I'm out of ideas other than a driver update since it's an unspecified exception.

Drakomis5 days ago

So this is the error I get now. When I run the game it still provides "unhandled exception".

Drakomis5 days ago

Three Eyes Software5 days ago

You could try moving the entire game folder to a users folder like downloads so it doesn't need any special permissions, though I don't think that's the problem since it looks like it's creating an access violation trying to read from a 64 bit memory adress.
I can't say anything about this beyond that since searching for this problem doesn't really return anything of substance, and KoboldCPP is third-party software which I didn't develop.

"full path to the model.gguf file here with one set of quotation marks" should be replaced with "G:\Silverpine Alpha 0.9.1 Experimental\Silverpine_Data\StreamingAssets\KoboldCPP\model.gguf" here, assuming you didn't move the folder.

Drakomis5 days ago

Thanks, yeah, I tried from downloads and it still did the same. I'm beyond confused I guess. I'm not sure what to do Haha.

Three Eyes Software5 days ago(+1)

Did you try it with OpenCL and the proper model path?

Drakomis5 days ago

Hey!

So I got it working by opening the kobold program first and utilize CLBlast, and the graphics card to a 1030 (which I don't have). It's odd. It connects to localhost and opens up KoboldAI Lite in my browser. So....yeah, it works, but...I don't know what I did honestly. Can't launch the game solo though, program won't start unless I manually input the variables.

Drakomis5 days ago (1 edit)

I managed to grab this screenshot. After this the command prompt window closes automatically and the game displays, "Unable to load AI model" or something and only gives the option to quit. Here it is:

Three Eyes Software5 days ago

This doesn't seem to be a known error but maybe the new KoboldCPP version fixes it.

itch.io

Viewing post in Silverpine comments