This has nothing to do with "model" being unsafe or too powerful or whatever else excuse Antropic wants to use to ban competition.
This is equivalent of sql injection and normal worm.
This has nothing to do with "model" being unsafe or too powerful or whatever else excuse Antropic wants to use to ban competition.
This is equivalent of sql injection and normal worm.
Security aspect is honestly a non-story here.
The same process happens in the perfectly "secure" case of errors in text. They propagate. People pay way too little attention to that, even though unlike security stories, this affects many if not most LLM users at this point.