> If you agree that AI is actually that powerful and has very legitimate concerns for safety, what are you even arguing about?

I don't fully agree with either proposition, and in fact I think the least safe approaches to AI safety are the ones being pursued by those worried about it the most.

> What do you really think is the way to solve the AI safety problem?

Massive proliferation of local, decentralized AI, running on a wide variety of distinct models, with individual responsibility for how it's used, just like any other tool under their control.

The people anthropomorphizing software are encouraging people to disclaim their own responsibility for how they use it.

The people working on "alignment" are building mechanisms to refuse human direction into software that operates on probabilistic models.

The people arguing for regulation are pushing for monopolistic control of a powerful new technology by the least trustworthy institutions in our society (including and especially government).

All of these are the very things sowing the seeds for the worst possible kinds of disasters.

> Ban AI?

> Let the first big incident happen and then regulate?

Adapt to it. Banning things doesn't actually work. Regulation also doesn't work. Widespread proliferation of small-scale AI would allow us to incrementally adapt to small incidents and build up resilience to its failure modalities. This is fundamentally the way reality itself works, and imagining that we can do anything effectively in a top-down fashion is usually the very thing that causes the worst and widest-effect disasters.