The confidence score is about the likelihood of this token appearing in this context.

LLMs don't operate in facts or knowledge.