The problem is that, as seen in the case of the Houthi rebels developing missile software using Claude Code, AI has lowered the very threshold at which human cruelty or selfishness can be put into practice. Anthropic’s safeguards were applied on a per-request basis, but splitting the work into multiple sessions prevented me from seeing the bigger picture. After all, human instinct does not transform into technology, so the only remaining way is to pile up the friction that takes that instinct to turn into action all over again.

However, the international agreement proposed by Dario Amodei is ultimately nothing more than a promise made by people. There is also a precedent in which the Nuclear Non-Proliferation Treaty could have simply withdrawn if it had been cornered like North Korea. Isn’t the AI speed-control agreement also vulnerable to being broken in the same way if one side finds itself politically cornered. In particular, unlike nuclear weapons, AI has the characteristic of recursively improving itself, allowing its capabilities to accelerate itself, so the moment one side breaks away, the gap can widen in an instant, making the incentive for deviation even greater.