Post by sefrim in How to run a local AI for Formamorph

Viewing post in How to run a local AI for Formamorph

Yeah. I have tried resetting the AI prompts starting a new world and adding the prompts you listed again but it just does it again. I'm using the veilwood swamp map and the world description being this.

a shadowy, forbidding location where sunlight barely pierces through the dense canopy of towering trees and tangled vines. The air is thick with humidity, and the ground is a mire of dark, murky water and creeping roots. Here, the vegetation is so tall and overgrown that it creates an almost perpetual twilight in some locations, making it difficult to discern what lurks in the shadows. Dangerous creatures, from venomous serpents to lurking predators, call this place home, hiding among the dense undergrowth and thick fog, however friendly and curious creatures can be found. The swamp is also a cradle for exotic and bizarre plants. The swamp is surrounded with tall mountains, stretching up into the clouds.

I tried to change it a little bit because I wanted it to stop talking about the journey or entity's saying let's go, we have a long journey ahead. I even tried resetting the world to its original settings only adding the extra entity's I wanted, but it would still mention the journey. Even if I would type something like "I sit down to rest and catch my breath" it would still be like "as you sit the catching your breath you can't help but wonder about the incredible journey ahead, this foreign world with so much wonder and majesty" then it would make me get up and keep moving lol. I don't know I'm probably messing something up somewhere. I know that AI is not going to be perfect, but I just feel like I'm missing something.

sefrim3 days ago (1 edit)

Ok so I followed your guide to running a local host. it seems to be much quicker and more responsive than going through open router for me. the question I have is. is there a limit to how much I can use it and what the max memory is? I was paying on open router so I was wondering if I can only play for so long before it stops me.

sefrim3 days ago (1 edit)

I have to say this is working significantly better than openrouter. I wonder if my internet could have been causing issues. the one thing I'm trying to get to work now is getting the kobold entities to speak in third person. I have it saying, kobolds always speak in third person in the entities description and I have it as entities that speak in third person always start with their name first when speaking. with your prompts the game is still kind of pulling me along but I have much more control now. I think I just need to try and fine tune it a bit.

MaliBogic9973 days ago

Glad to hear that it works better with the local host! I doubt it was the internet speed though, keep in mind that a lot of people use those models. Even the paid ones have their fair share of work.

If you are using LM Studio at its' default settings, it will automatically throw out the excessive memory once it nears the limit. The default setting for that is that the AI throws out the middle part, keeping the start (with the world rules) and the more recent prompts in memory.

For the weird sentence endings, you can try adding something like this to your prompt maybe? I got this from ChatGPT and it sounds like it should work.

> Only describe events, actions, and dialogue that are relevant to the player's current situation. Maintain an open-ended format.

As for the kobolds, something like this in the AI section of their entity entry should do the trick:

> The kobolds always address everybody in third person. Even when they talk about another of their kind, they use third person only.

sefrim3 days ago (1 edit)

they have made it much better! I also added Do not choose or suggest the player's next action. For example, if the player chooses to lay down do not respond that they fall asleep. Sadly, I had to switch from local host as I could not for the life of me get to enact even slightly sexual scenes. However, using your prompts and adding a few of my own I got microsoft/wizardlm-2-8x22b to work really well through openrouter! Now to hope it stays working well lol. Even with it not being an instruct. it seems to handle the stats just fine for the moment.

MaliBogic9973 days ago

To be honest, I think that the model no longer needs to be an "Instruct" model necessarily. The Instruct part was a necessity back before 1.1.0 because the game used a JSON format to control everything, but now that the game can just use plain text, any model should do the trick. The most complicated one would be for the stats, and even that is doable. I'll try out using a regular model for the game and maybe update the guide so that any generic text model can be used.

sefrim3 days ago

sounds good!

itch.io

Viewing post in How to run a local AI for Formamorph