News for hackers. Stuff that matters.

A comment on Understanding Shannon's Entropy metric for Information [pdf]. Parent comment

Re:Understanding Shannon's Entropy metric for Information [pdf] by canjobear on Friday October 08, 2021 @11:32AM (#28800378)
No, the interesting thing about Shannon entropy is that it is totally independent of how information is represented (as symbols, alphabets, numbers, structured objects, whatever).
[ Parent | on HN ]
Re:Understanding Shannon's Entropy metric for Information [pdf] by dr_dshiv on Friday October 08, 2021 @04:12PM (#28803655)
It is based on the symbol set exchanged, so how is it independent?
[ Parent | on HN ]
Re:Understanding Shannon's Entropy metric for Information [pdf] by canjobear on Friday October 08, 2021 @07:36PM (#28805437)
Information is a function only of the probabilities, not of the symbols.
[ Parent | on HN ]