This is what i am using btw. mistralai/mixtral-8x7b-instruct max memory at 32k and token output at 400 if any of that helps. using the 1.1.2 version of the game.
As far as I can tell, the world rules are pretty important for the AI. Normally when I specify something there, it keeps enforcing it. For example, I have a world where the player can cast hypnotization on an entity to control it as the player wishes. In the world rules, I stated that the effect is permanent. And lo and behold, not even my override word could undo the hypnotization! The answer from the AI was pretty much confusion, and the entity remained hypnotized.
Hmmm I see. I'll keep that in mind. I don't know if it's the AI that I'm using or what, but the text always ends with something like this. As your journey unfolds you can't wait to see what is around every corner. This mystical land and all its splendor eager to revel its secrets, sometimes I'm just trying to have a convo or something and if I'm traveling with someone its will constantly talk about our bonding in different ways. when I go to speak sometimes it just says that they respond its doesn't show my question and most the time it doesn't text what they are saying. just explaining it like a narrator like you ask so and so and they say back to you this or that but not ever the entity speaking. I don't mind it here or there but its every time lol. Just seems like a waste of text to me. I have tried quite a few things like, switch the prompts around or, try to tell it how to narrate. But it just seems to want to constantly remind me about the entire world I'm in and how everything I do makes me and my companion bond lol. I am using your Prompts you listed above, but it just won't stop doing it.
Yeah. I have tried resetting the AI prompts starting a new world and adding the prompts you listed again but it just does it again. I'm using the veilwood swamp map and the world description being this.
a shadowy, forbidding location where sunlight barely pierces through the dense canopy of towering trees and tangled vines. The air is thick with humidity, and the ground is a mire of dark, murky water and creeping roots. Here, the vegetation is so tall and overgrown that it creates an almost perpetual twilight in some locations, making it difficult to discern what lurks in the shadows. Dangerous creatures, from venomous serpents to lurking predators, call this place home, hiding among the dense undergrowth and thick fog, however friendly and curious creatures can be found. The swamp is also a cradle for exotic and bizarre plants. The swamp is surrounded with tall mountains, stretching up into the clouds.
I tried to change it a little bit because I wanted it to stop talking about the journey or entity's saying let's go, we have a long journey ahead. I even tried resetting the world to its original settings only adding the extra entity's I wanted, but it would still mention the journey. Even if I would type something like "I sit down to rest and catch my breath" it would still be like "as you sit the catching your breath you can't help but wonder about the incredible journey ahead, this foreign world with so much wonder and majesty" then it would make me get up and keep moving lol. I don't know I'm probably messing something up somewhere. I know that AI is not going to be perfect, but I just feel like I'm missing something.
Ok so I followed your guide to running a local host. it seems to be much quicker and more responsive than going through open router for me. the question I have is. is there a limit to how much I can use it and what the max memory is? I was paying on open router so I was wondering if I can only play for so long before it stops me.
I have to say this is working significantly better than openrouter. I wonder if my internet could have been causing issues. the one thing I'm trying to get to work now is getting the kobold entities to speak in third person. I have it saying, kobolds always speak in third person in the entities description and I have it as entities that speak in third person always start with their name first when speaking. with your prompts the game is still kind of pulling me along but I have much more control now. I think I just need to try and fine tune it a bit.
Glad to hear that it works better with the local host! I doubt it was the internet speed though, keep in mind that a lot of people use those models. Even the paid ones have their fair share of work.
If you are using LM Studio at its' default settings, it will automatically throw out the excessive memory once it nears the limit. The default setting for that is that the AI throws out the middle part, keeping the start (with the world rules) and the more recent prompts in memory.
For the weird sentence endings, you can try adding something like this to your prompt maybe? I got this from ChatGPT and it sounds like it should work.
> Only describe events, actions, and dialogue that are relevant to the player's current situation. Maintain an open-ended format.
As for the kobolds, something like this in the AI section of their entity entry should do the trick:
> The kobolds always address everybody in third person. Even when they talk about another of their kind, they use third person only.
they have made it much better! I also added Do not choose or suggest the player's next action. For example, if the player chooses to lay down do not respond that they fall asleep. Sadly, I had to switch from local host as I could not for the life of me get to enact even slightly sexual scenes. However, using your prompts and adding a few of my own I got microsoft/wizardlm-2-8x22b to work really well through openrouter! Now to hope it stays working well lol. Even with it not being an instruct. it seems to handle the stats just fine for the moment.
To be honest, I think that the model no longer needs to be an "Instruct" model necessarily. The Instruct part was a necessity back before 1.1.0 because the game used a JSON format to control everything, but now that the game can just use plain text, any model should do the trick. The most complicated one would be for the stats, and even that is doable. I'll try out using a regular model for the game and maybe update the guide so that any generic text model can be used.