I love 3b1b and I love that video, but that also isn't exactly what is being said. In particular llm inference does add information (in the meaning in this context) because the output distribution is sampled randomly.