> Here's something most developers overlook: if an LLM has a 2% JSON defect rate, and Response Healing drops that to 1%, you haven't just made a 1% improvement. You've cut your defects, bugs, and support tickets in half.
If part of my system can't even manage to output JSON reliably, it needs way more "healing" than syntax munging. This comes across as naive.
Plus, that claim isn't even true. A 1% and 2% JSON defect rate are going to annoy a similar amount of people into filing bugs and tickets.
1% fail rate on API requests is horrifyingly embarrassing.
Sounds like we are twice as close to AGI!
"it's not just X, it's Y"
Don't you worry about Planet Express, let me worry about blank.
Model itself can't output JSON reliably. It's on you building a system around the model to make sure it either returns correct output or errors which is trivial to do.
But, but, you've just cut your defects, bugs, and support tickets in half!
[dead]
[dead]