I have been using it to train a few BERT models.

I doubt BERT would trip safeguards

It didnt, just small enough, which is good, its way more useful to train small purposeful models than to use an entire frontier LLM.