Re:A Friendly Introduction to Cross-Entropy Loss (2016)
by rerx on Thursday June 07, 2018 @03:10AM
(#17253886)
The cross entropy can be understood as the expected number of bits you need to specify some event if you assume an underlying distribution. It is large if your assumed distribution is very different from the true distribution. This is indeed helpful intuition for making sense of formulas in machine learning.
[ Parent
| on HN ]
There are no comments on this comment yet.