Much ago about nothing. I find the whole premise ridiculous: to protect against "catastrophic risks posed by increasingly powerful models".
I mean what kind of a catastrophe are we talking about? Nuclear holocaust? The end of humanity?
(Famous last words...)