> LLM's, in their present stage of development, are sort of like a crack-addled idiot savant. Sometimes they are obviously insane, and sometimes they seem quite cogent, but you must never trust them implicitly.
I have nothing to add. Just wanted to save this quote for posterity. Thank you.
The similar comparison I enjoy is “a golden retriever on LSD”.
If you apply the dogs on acid mental model it helps establish appropriate levels of trust.