> I’m shocked how many otherwise well-informed people don’t understand or agree with this very fundamental fact of just how little we actually understand about why LLMs work as well as they do.
Well-informed people understand that LLMs work as well as they do for the same reasons as horoscopes, fortune-telling and homeopathy.
They work great for banging out POC apps or writing boilerplate code. This is a real use.
Homeopathy triggers the placebo effect. That is a real use.
If horoscopes and homeopathy can generate tests, then call me a Pisces and pass me the singular molecule of deadly nightshade toxin.
Be careful what you wish for. This weekend in tearing out hundreds of crappy tests that got vibed into a codebase.
...well, you could train an LLM on whatever horoscopes and then ask it :-?