> I suspect that what he means is something like "artificial intelligence, but that works just like human intelligence".

I think he means "something that can discover new areas of mathematics".

In that case, I'm afraid many people, myself included, would not be describable as "general intelligences"!

> "something that can discover new areas of mathematics".

How many software engineers with a good math education can do this?

Very reasonable, given his background!

That does seem awfully specific though, in the context of talking about "general" intelligence. But I suppose it could rightly be argued that any intelligence capable of "discovering new areas of mathematics" would inherently need to be fairly general.

> That does seem awfully specific though

It's one of a large set of attributes you would expect in something called "AGI."

Then I don't get the distinction between AGI and superintelligence. Is there one?

I agree with /u/AnimalMuppet, FWIW. As long as I've been doing this stuff (and I've been doing it for quite some time) AGI has been interpreted (somewhat loosely) as something like "Intelligence equivalent to an average human adult" or just "human level intelligence". But as /u/AnimalMuppet points out, there's quite a bit of variance to human intelligence, and nobody ever really specified in detail exactly which "human intelligence" AGI was meant to correspond to.

SuperIntelligence (or ASI), OTOH, has - so far as I can recall - always been even more loosely specified, and translates roughly to "an intelligence beyond any human intelligence".

Another term you might hear, although not as frequently, is "Universal Artificial Intelligence". This comes mostly from the work of Marcus Hutter[1] and means something approximately like "an intelligence that can solve any problem that can, in principle, be solved".

[1]: https://www.hutter1.net/ai/uaibook.htm

AGI is human-level. (What human level is a question. High school? College graduate? PhD? Terrence Tao?)

Superintelligence is smarter than Terrence Tao, or any other human.

I’d love to take that bet