Guns also can't hold copyright; can they be charged with crime? (hint: it's the operator who gets charged).
but not the gun manufacturers
Wasn't it both in this case? The gun maker, when testing their gun, shot someone.
When it is the gun they make that is itself responsible, yes. See Sig Sauer P320 malfunction or lawsuits[0]
[0] https://en.wikipedia.org/wiki/SIG_Sauer_P320#Lawsuits
There are known standards for how a gun should perform. This probably wouldn't go the same for LLMs, since anyone using them in such a serious manner knows they are quite unpredictable.
but not the gun manufacturers
Wasn't it both in this case? The gun maker, when testing their gun, shot someone.
When it is the gun they make that is itself responsible, yes. See Sig Sauer P320 malfunction or lawsuits[0]
[0] https://en.wikipedia.org/wiki/SIG_Sauer_P320#Lawsuits
There are known standards for how a gun should perform. This probably wouldn't go the same for LLMs, since anyone using them in such a serious manner knows they are quite unpredictable.