Re:A man who tried to redeem the world with logic (2015)
by Schiphol on Thursday February 10, 2022 @02:21AM
(#30283309)
> according to Shannon's original Theory of Communication
But not according to Wiener's notion of information, which is, as both theorists agreed, equivalent to Shannon's up to a change in sign.
Errata: The article says "The higher the probability, the higher the entropy and the lower the information content." It should say "the lower the entropy", of course, as the definition of information is the same as the definition of entropy (they are correlated, not anti-correlated): white noise has the lowest probability (it's impossible to predict), the highest entropy and therefore the highest information content, according to Shannon's original Theory of Communication.