For code it also has tools to verify correctness. From specifications to compilers and tests.

With humans language, sometimes "wrong" is in fact "right."

Good point. I also think that the training data is different in this regard. It has trained on (mostly) verified, correct code, but when in comes to free text it has trained on a lot of unfounded opinions.