We use Haiku 4.5 inside our product. It continues to be absurdly capable for converting natural language to structured JSON based on a set of fairly complex business rules.
We use Haiku 4.5 inside our product. It continues to be absurdly capable for converting natural language to structured JSON based on a set of fairly complex business rules.
bro why. its literally the most overpriced model in existence right now. i could name about 10 models off the top of my head that would be better and cheaper
We tried Luna and it scored way lower in our evals. Muse also. We haven't had a chance to test others.
How much time were you able to put into tuning your prompts? And was it worse on all fronts (cost, latency, accuracy) or just some?