Re:Ideas in statistics that have powered AI
by ansk on Wednesday July 07, 2021 @03:08PM
(#27764695)
You've correctly shown that maximizing the likelihood is equivalent to minimizing cross entropy in the discrete case, but frankly that is unrelated to your claim that the equivalency doesn't hold in the general case. As noted in the sibling comment, the generalization to the continuous case is evident when viewing the empirical data distribution as a mixture of dirac densities.
[ Parent
| on HN ]
Re:Ideas in statistics that have powered AI
by whimsicalism on Wednesday July 07, 2021 @04:57PM
(#27765649)
Hm, I never really thought about it this way - but I guess it does generalize to continuous space in a pretty natural way.