Scary stuff from one of the winners:
"A Taxonomy of Omnicidal Futures Involving Artificial Intelligence"
(Jacob Tsimerman, Andrew Critch)
Scary stuff from one of the winners:
"A Taxonomy of Omnicidal Futures Involving Artificial Intelligence"
(Jacob Tsimerman, Andrew Critch)
Jacob Tsimerman believes that AI will be better than human mathematicians within 2 years.
We should not be surprised if AI solves the Millenium problems very soon and advances to a level that is barely comprehensible, or even incomprehensible, to the best humans.
We can expect this not by curve fitting to recent progress but by reasoning from first principles about where the progress has come from (synthetic data, non-human corpus) that has no obvious upper bound on capabilities.
Does anyone know if Tsimerman talked about AI extinction risk at other places? Critch has worked long-term in the field (MIRI, CHAI) but I was surprised to see this colab.
This is a piece of sci-fi formatted with LaTeX so it looks like philosophy.
Just by reading the abstract it's terrifying.