Opus 5 has a habit of taking what I asked for, doing something tangentially related to it, and then lying to me and saying it did exactly what I asked.
Opus 5 has a habit of taking what I asked for, doing something tangentially related to it, and then lying to me and saying it did exactly what I asked.
It even adds comments to say you asked for [thing] then leaves snarky comments about when you correct it.
At that point I decided it's just not worth the babysitting that's required, and you are better off working entirely with other models.
If the harness itself was open source then maybe we'd be able to wrap it up in a reasonable layer of sanity.