Behold the actual definition of cross entropy: https://en.wikipedia.org/wiki/Cross-entropy
It's true that the PyTorch API conflates cross entropy and softmax, but they are separate concepts.
Behold the actual definition of cross entropy: https://en.wikipedia.org/wiki/Cross-entropy
It's true that the PyTorch API conflates cross entropy and softmax, but they are separate concepts.