> but a response to that is to just make them more relentless which is a pretty poor solution for everyone involved

I see two problems with LLMs & agents which wont be fixed possibly forever.

1) They dont have causal models. What they can do only is trial-and-error exploration which works quite well for many problems. But many other problems require a causal model.

2) Prompts lack precision, and programming languages and machine models were invented to solve this problem. English is great, but it is not a programming language.