Yo Dawg , you love hallucination so we develop drugs with LLM.

i hear this so often, how often does an LLM hallicinate for you now? Like 2023 levels? In your daily AI use, do you see gibberish, made-up facts, things that just don't make sense?

gibberish no, made up facts probably in about half of all responses it gives me dozens of times a day, things that dont make sense (internal contradictions in a single response) multiple times a day.

on average it is fine. On difficult tasks it still does hallucinate. - like decision based on huge policy documents ( context reaching around 900k)

A lot less these days tho.