I think the problem is that agents are inherently stochastic. Their idea of simplification changes from message to message because whatever objective it’s operating on internally is inherently opaque and changes. No matter how much you prompt it, eventually it’s going to not do what you want it to do.
I built https://github.com/thempatel/mdlr for precisely this reason: externalize the objective and force the agent to meet it.
Interesting, I'll be testing your tool on my repos. You should publish to crates.io!
Thank you so much! I am open to any and all feedback. Please file an issue or discussion if you have things you'd like to share.
Getting this onto crates.io is a great suggestion, I will look into that!