So Not wanting to speak for the Dev, which i know already replied, but it does help to run your own AI locally if you have the computer to do it, there is a thread on how to do it pinned in the community here. It saves a lot of headache if you can, and if you can I can get about 13k context tokens (IE roughly 52,000 Characters, 1 token = roughly 4 letters) on 32 Gb or RAM and a RTX 3070 laptop. I am aware it's a bit higher spec than what most people run, but the 13K is all run on the 3070, which is about 12 GB in RAM. Would I suggest flooding your RAM for it, no, but the game, at least when going through the story, seems to only log and send roughly 2K context memory, so 8K characters, and the rest is used for things like System Prompt Additions, Stat entries, Entity entries, locations, and traits. so that is, the story itself, and agin, this maybe wrong, it's just what I have noticed when I created my own scenerios, only keeps about 2K in context memory, and if it does, Dev man, you are amazing, I love you, all I want for christmas is a way to adjust how many game context tokens you can tell the game to send to the AI. Within reason, I know you're already down a kidney.
all I want for christmas is a way to adjust how many game context tokens you can tell the game to send to the AI
Its in settings, memory limit (not that the memory limit here only counts the game events and the world data is on top of it)
In the settings of the game, the token output what exactly does that do?
It determines how many output tokens max, more max tokens mean the AI write more and more text
ahhh I see. Something else I noticed and I just figured it’s the way AI work but when I type in a command. Like say “look for a water source” I notice that the AI will say I find a water source and then drink from it. If I don’t want the AI to make me do something do I need to be more specific with how I explain what I want to do? Also sometimes when it generates the text it will only be around one sentence long. Does that have something to do with my internet connection? The settings I have in game are the default where it says paragraph, essay style. I have not touched that stuff.
Yeah, sadly the AI will assume that, if you look for food or water, you will automatically want to eat or drink it. What I have found to help is to specify in the game text prompt that the AI cannot take actions for the player. If the player wants to find water, then the player will ONLY find water and do nothing else until specified further. Without fixing it too hard (so that the AI does allow some new events, like entities, to stroll in), you could add something like this to your game prompt:
The response can't assume or take any actions in behalf of the player.