Thanks for this.
Built this myself using Gemma4, but the branching is neat. Will have to try it.
If you're packing the questions into the branches, is there a chance that the ordering of the questions can change the probability of each output?
I see you have packs, but as close to deterministic as possible is what I'm after.
Yes, determinism is actually something we spent a lot of time to achieve. The general answer is yes, especially on certain architectures, with some caveats and some methods to increase it. You can find more info in docs/BATCH_INVARIANCE.md
[flagged]