This take feels a little like the clergy saying printing presses are dangerous because people will read bad things and spread bad ideas. Turns out they totalky did, but on net it's a small price to pay for widespread literacy.

Right, but the widespread literacy took generations to take hold. But, the threat was immediate.

I think, in the long run, of course AI is a boon. But I’m not immortal, and right now it’s a threat to all our livelihoods. We should put ourselves first, and be selfish, while we’re still alive to be selfish.

Interesting perspective but don't you think it's too late? Opus 4.8 can already replace most developers. Companies are already cutting the bottom half of the work force, since Opus on a cron can churn out bug fixes.

Maybe there's some hope that if we stop here, we'll still need senior level developers to guide the models and step in where they (occasionally) fall short? Maybe Mythos/Fable was the first time where that was no longer really true?

I'd disagree. I saw plenty of really mediocre work from Fable, especially in various niche programing endeavors (graphics comes to mind). It doesn't strike me as the "end to all programmers" yet... though fast forward 10 years and it seems inevitable that all of our salaries will be halved, if not more.

If the price to pay is total human disempowerment, I think it's worth getting everyone on the same page before we proceed.

This is a steel man of Anthropic's argument, though, and the premise that there could have been a different thing they claimed that would hold up more doesn't and shouldn't defend their position. To the extent to which it comes down to automating and replacing the need for humans or supporting runaway execution that might accidentally kill all the humans, Anthropic routinely measures it, warns of it, and then releases it. Instead, it is only with respect to specific functionality -- much of which is suspiciously beneficial to them, as they internally claim to use AI to improve their own products while also constantly whining about other people using their AI to improve their products -- that they will put a ton of effort into limiting the access or applicability. The day I boot up Claude and ask it to design a website or automate my paperclip factory and it refuses on ethical grounds is the day Anthropic might seem a little less hypocritical.