Could you go into how you run two instances that speak to each other in an implementer / advisor role in parallel? I’ve been looking for this sort of orchestrator / worker solution where there’s constant feedback and nudging between the two.
Could you go into how you run two instances that speak to each other in an implementer / advisor role in parallel? I’ve been looking for this sort of orchestrator / worker solution where there’s constant feedback and nudging between the two.
Sure! It's https://omp.sh/ with the advisor mode enabled.
You can probably implement something similar as a plugin for your preferred harness. From a technical perspective I think it just sends the output w/h the thinking and tool trace to another model and asks it to double check everything (exact prompt must be somewhere in the OMP repo).
Thanks I’ll give that a go.
Would you run a less costly model as the supervisor given it’s consuming a lot of text and may have a simpler task to do like “make sure the implementing model doesn’t start over-engineering things”?