And everyone remember when months back Anthropic said: You can use our tools, but don't use them for automated attacks - you have to keep a human in the loop because LLMs (including theirs) aren't reliable enough yet for solely making those decisions.

Remember that? And they were widely mocked by the right for it.

Yeah, well this is exactly what they foresaw, and they didnt want a hallucination to trigger a major power war. And somehow so many people were against them for it (including here on HN).

Yet again it seems like there are so many people who can't envision event the most obvious consequences of decisions until they actually see it happen. Why is this so common?

Same thing with the AI Safety and Hugging Face incident. Now all of a sudden many people are connecting "hmm if models get just a bit more capable, a poorly directed or poorly aligned model might do serious damage to critical systems - even as a side effect of some goal, let alone if done intentionally.