I'm not sure why you say the analogy fails just because general AI has more applications than excavators. A tool is still a tool, regardless of how much human effort it replaces.

"Calculator" used to be a job title. Now it's a machine. In the same way, "construction worker" may one day be a machine. "Software engineer" may one day be a machine. "Engineer" in general may one day be a machine. This forum seems to think that if humans are not required to think hard about existing problem domains, something terrible will happen.

At the end of the AI revolution, thinking may become something like physical exercise -- something we do because it's fun, and keeps us healthy and attractive, not because it's required.

To be clear, I do think that AI poses a potential risk to humanity. But imo "we won't have to think as hard" is not a risk; it's a benefit.

People already do a lot of thinking for fun. They read novels, they write software, they do crossword puzzles, they play chess.

My experience at home and work is the more “thinking” these tools do, the more it frees me up to think about something else, usually something harder.

The mention of exercise brought this to mind:

https://youtu.be/O6SEXp3-lo8?is=jJ55WL3ZvFoG6G8u

yes ... I do think that if humans stop thinking hard about existing problem domains .. they will lose that ability.

From which it then follows that _all_ technology and science become magical incantations dictated by a black-box oracle, whom everyone trusts and no one understands.

That could happen in a couple of decades.

"technology and science become magical incantations dictated by a black-box oracle, whom everyone trusts and no one understands"

I don't see why this would be a terrible thing.

This is what humanity has done for thousands of years. We do things manually for a long time, then invent an efficient way to automate it, and the skills to do things manually are gradually lost.

A car is a magic black box that we trust to move us around. A smartphone is a magic black box that we trust to connect to the rest of the world. AI is just the latest invention in a long line of magic black boxes that we trust. If you'd prefer to live your life without a car or smartphone or AI, it is perfectly acceptable to do so, and there are communities of people who do that.

I think I'm detecting a concern that "if we don't understand how it works, it could start doing dangerous things". To that I would say: even if something is a magic black box, we can still improve it and make it safer. To invent an airbag, you don't need to understand how a car works.

If people don’t use muscle power for work, and people don’t think for work, what are people going to fi?

Maybe the new scarce resource will be meaning, and we’ll kill each other for that