Delaying a technology release is not going to stop that in the long term. Society, culture, and the support tooling just needs to adapt. Just like how AI coding is still in the early days.
The sooner people learn the risks and build the infrastructure to make it fail less the better.
> All these points are valid, and OpenAI did a great job identifying potential risks, especially misuse and biases, at an early stage.
Many of the OpenAI employees who were focused on these risks in GPT-2 later founded Anthropic, notably Dario [1]. Since the beginning and continuing through today Anthropic describes itself as an "AI safety and research company" [2]
I'm not sure if the OpenAI of today has the same focus on safety, or if they do the minimum to not look irresponsible given Anthropic's effort.
People quote the "GPT-2 is too dangerous to release" thing as if it were wrong, but given all the slop all over social media and how it's used to create division and attack social cohesion, he was clearly right.
He was kinda right.
Lawyers, doctors, students, teachers. Lots of people using GPT models carelessly in harmful ways.
Obviously not what he meant at the time but hilarious(ly sad) in retrospect.
Delaying a technology release is not going to stop that in the long term. Society, culture, and the support tooling just needs to adapt. Just like how AI coding is still in the early days.
The sooner people learn the risks and build the infrastructure to make it fail less the better.
The claim I remember was that releasing it would start an arms race for AGI, which was absolutely true
If it was truely an arm's race to AGI they would've stopped relying on the data/param scaling law BS ages ago.
"Malicious use" means spam, propaganda bots, etc. It's nice to give people who work on spam filters some heads-up.
It's clear that the parent didn't bother to read the link they shared, which articulates exactly this. That's embarrassing.
From the link:
> They summarized their findings from the nine months:
> 1. Humans find GPT-2 outputs convincing.
> 2. GPT-2 can be fine-tuned for misuse.
> 3. Detection is challenging (detection rates of ~95% for detecting 1.5B GPT-2-generated text by RoBERTa).
> We’ve seen no strong evidence of misuse so far.
> We need standards for studying bias.
>
> All these points are valid, and OpenAI did a great job identifying potential risks, especially misuse and biases, at an early stage.
> All these points are valid, and OpenAI did a great job identifying potential risks, especially misuse and biases, at an early stage.
Many of the OpenAI employees who were focused on these risks in GPT-2 later founded Anthropic, notably Dario [1]. Since the beginning and continuing through today Anthropic describes itself as an "AI safety and research company" [2]
I'm not sure if the OpenAI of today has the same focus on safety, or if they do the minimum to not look irresponsible given Anthropic's effort.
[1] https://en.wikipedia.org/wiki/Dario_Amodei
[2] https://www.anthropic.com/company
Just to be clear: that is quoted text from the source and not a statement I'm making, in case that's what you're suggesting here.
People quote the "GPT-2 is too dangerous to release" thing as if it were wrong, but given all the slop all over social media and how it's used to create division and attack social cohesion, he was clearly right.
History is long and never over, so he could easily be right both times before this is through.
That guy is the biggest clown lmao