Yes, a "select" (rather, self-selected) elite "controlling" AI according to their wishes, what could go wrong?

Clearly not a "better" scenario. The real problem though seems people feigning helplessness? You can't leave society "to its own". You are part of it and go where it goes. So better start steering.

When access to AI gives you abilities you cannot use responsibly, you shouldn't have access to that. Just like you shouldn't be allowed to drive a car or fly a plane or command a rocket without proper guardrails, safeguards, prerequisites, etc.

"General" intelligence isn't present in humans, why does it need to be in AI?

> When access to AI gives you abilities you cannot use responsibly, you shouldn't have access to that.

What do you mean "cannot"? As in you are granted abilities that have no responsible use?

"Cannot" as in presently cannot. That includes the case of things that have no responsible use.

You live in a curated world and rarely or never encounter such things. Precisely because your environment is curated that way.

Look at how you can't buy WMDs. They have no responsible use for you.

> When access to AI gives you abilities you cannot use responsibly

I don't think this is realistically a problem at all. It just makes certain types of research cheaper and less time-consuming. And, again, this is also a problem with the american services.