Something can be a true fact and still be an ill-advised or tone deaf thing to say.

Especially when you take into account that people are largely unconcerned about true facts, and will gladly misquote or misinterpret you just in order to be outraged.