Isn't that what they're doing? "There's a better than 0 chance this thing could kill everyone in the next decade."

That might be too imprecise for the HN set but it's realistic for laypeople.

And none of the AI people talking about the risk are running into rooms full of people telling them Claude has gone mad and yelling at them to disconnect from the internet and turn off their devices immediately.