You can make any LLM deterministic by dropping the temperature hyperparameter to zero.
This will generally make them suck, though, a little bit of randomness is necessary for proper function.
You can make any LLM deterministic by dropping the temperature hyperparameter to zero.
This will generally make them suck, though, a little bit of randomness is necessary for proper function.
You can also use a fixed seed for your prng. A hash of the input text (up to the current turn) should do.