For what it’s worth I tried an experiment where I had a similar harness (where LLMs competed head to head playing snake) and made them aware of their budget and it had very little impact. This was cheaper open weight models
For what it’s worth I tried an experiment where I had a similar harness (where LLMs competed head to head playing snake) and made them aware of their budget and it had very little impact. This was cheaper open weight models