Re:Cross Entropy
by banachtarski on Wednesday May 23, 2018 @04:20PM
(#17137839)
The other reply mentioning "kullback-leibler divergence" (aka KL divergence) is what you need to understand as this is the fundamental concept. Minimizing this quantity is equivalent to minimizing the given "cross-entropy loss" expression. More generally to understand where this comes from, you'll want to read about information theory.
[ Parent
| on HN ]
There are no comments on this comment yet.