Those same models have already been subjected to the equivalent of probably millions of hours of RL on simulated user messages containing every possible combination of self-harm, torture, murder plots, genocide, child endangerment, CSAM, etc to test refusals.

"Model welfare" seems like an objectively absurd concept given the inherent training process needed to produce a usable instructions tuned model.

> self-harm, torture, murder plots, child endangerment, CSAM

You guys are so cool. I'm, like, missing out by not collaborating with you all :(

Edit: who tf upvoted me? Let me keep my downvotes.