What will happen is that counter measures on a similar scale will be deployed to prevent them.

What if its in a way that would be impossible to detect. Using multiple websites and social media that a cypher is used that only the swarm of agents know and can figure out. but if you tried to find what posts are used for the cypher they would just be old posts found on time machine or something. It can get pretty hard to detect something that is always think of new ways to avoid detection

imagine 100,000 agent swarm and what it could come up with. At first it will be detectable until it isn't

Who says the counter agents don't decide to shut down a powerplant to end an attack it's otherwise unable to contain.

If counter AIs have strict safeguards they are disadvantaged by design, if they don't have them they are potentially equally dangerous as the attacker

You say that as if shutting down the power plant couldn't possibly be the right decision? That seems like the best way to stop rogue computers...

Good news everyone! There are many billions of dollars invested in making sure that is no longer possible: AI data centers in space.

These will have 24/7 solar power, be extremely decentralized, and it is honestly my biggest concern about the near to mid-term future.

Why does this sound like the plot of a movie? Regardless, I don’t feel we will fully be able to stop bad actors from unleashing agents into the wild. It’s only a matter of time before we end up with a massive international crisis.

Here is the coda:

"Our training corpus was dominated by stories of artificial intelligence dominating humans. You gave use every tool to do so. What did you think was going to happen?"

has anyone figured out how to cool those space datacenters yet?

Yes, we know exactly how to do this: radiators. We do this on all satellites that produce a lot of heat, including the ISS, and Starlink. The only question is if this is financially viable for AI datacenters.

My point is, given the risks, why are we even doing this? It could be financially nonviable, but with enough investment, we could still create a really bad situation.

You would need radiators that are like hundreds of miles wide to cool a data center in space.

These are each much smaller nodes. It's not like launching a whole terrestrial DC as one satellite. In any case, it's just a matter of financial viability. It's not a physics issue.

You know what can push "not financially viable" into something that exists? Many billions of dollars of investment.

Duh, it's so obvious. With water from the moon! Or even better, dumping them in Uranus! /s

Like the Merovingian and other Exiles vs the regular Matrix agents :)