> and anyone who think they may be is delusional

My entire point was that vulnerable (i.e, delusional, psychotic, bipolar, children) cannot always make rational decisions.

China has already banned any LLM from giving any type of medical/psychiatric advice because an LLM company has absolutely no right to allow their product to give out that type of advice.

OpenAI can't even contain its internal models and idiots believe that these companies can do whatever they like.

Read the damn link I shared. People are dying and murdering others because of the advice of LLMs. Children are becoming attached to LLM "friends" because they don't understand what it really is. Hell, most parents I know still don't fully understand the dangers of these models.

If an LLM simply replied, "I'm sorry, I cannot give guidance on that topic" people would still be alive today.

It is amazing to me that people like you understand that LLMs shouldn't be telling people how to make a bomb, but it is totally fine if it tells some who is suicidal to kill themselves.

LLMs can be used for good. Giving bad advice to vulnerable people is NOT good.

/ignored