News for hackers. Stuff that matters.
Re:Cross Entropy by banachtarski on Wednesday May 23, 2018 @04:20PM (#17137839)
The other reply mentioning "kullback-leibler divergence" (aka KL divergence) is what you need to understand as this is the fundamental concept. Minimizing this quantity is equivalent to minimizing the given "cross-entropy loss" expression. More generally to understand where this comes from, you'll want to read about information theory.

There are no comments on this comment yet.