I feel like "detecting when output is wrong, knowing what to verify" is the key skill, but it's also extremely demanding.

You need to have a very solid understanding of things like sources, and bias, and how to evaluate if something is likely to be true, and how to get to a credible answer.

Given the number of people online who try to read arguments with screenshots of a ChatGPT conversation, this is not an obvious process at all.