We have massively increased our brain by scaling out not up. Going from pop. 8M to 8Bn is a 1000x

Hardly. What's the use if no single component of this brain can hold a complex enough idea?

How complex are the ideas held by a single neuron?

There's so many barriers between individual humans. Neurons on the other hand are tightly intertwined.

We deal with that by abstraction and top-down compartmentalisation of complex systems. I mean look at the machines we build. Trying to understand the entire thing holistically is impossible thing for a human mind, but we can divide and conquer the problem, where each component is understood in isolation.

Look at that in the organizations - businesses, nonprofit, and governmental systems we build.

No one person can build even a single modern pencil - as Friedman said, consider the iron mines where the steel was dug up to make the saws to cut the wood, and then realize you have to also get graphite, rubber, paints, dyes, glues, brass for the ferrule, and so on. Consider the enormous far greater complexity in a major software program - we break it down and communicate in tokens the size of Jira tickets until big corporations can write an operating system.

A business of 1,000 employees is not 1,000 times as smart as a human, but by abstracting its aims into a bureacracy that combines those humans together, it can accomplish tasks that none of them could achieve on their own.

Robert Miles has a video on this

https://www.youtube.com/watch?v=L5pUA3LsEaw

Think of AGI like a corporation?

OTOH. Burn a stick, and you can write with the burnt end

[deleted]

Countries and companies hold pretty complex ideas

We are smart enough to build the intelligence! Not just AI. We use computers to solve all kinds of physics and maths problems.

Corporations with extreme specializations are that.