I agree, and also

> A court has already called the training fair use

isn't dispositive. Another court, a less stupid or corrupt one, could decide differently. SCOTUS could decide differently.

But using illegally obtained material as the foundation of your business and destroying it for fear of litigation, both of those things are clearly criminal.