News for hackers. Stuff that matters.
Re:What Is Entropy? by kragen on Tuesday July 23, 2024 @09:12AM (#41045637)
shannon entropy is subjective for bayesians and objective for frequentists
Re:What Is Entropy? by marcosdumay on Tuesday July 23, 2024 @02:48PM (#41049455)
The entropy is objective if you completely define the communication channel, and subjective if you weave the definition away.
Re:What Is Entropy? by kragen on Tuesday July 23, 2024 @04:36PM (#41050529)
the subjectivity doesn't stem from the definition of the channel but from the model of the information source. what's the prior probability that you intended to say 'weave', for example? that depends on which model of your mind we are using. frequentists argue that there is an objectively correct model of your mind we should always use, and bayesians argue that it depends on our prior knowledge about your mind
Re:What Is Entropy? by kragen on Wednesday July 24, 2024 @04:08AM (#41054676)
(i mean, your information about what the channel does is also potentially incomplete, so the same divergence in definitions could arise there too, but the subjectivity doesn't just stem from the definition of the channel; and shannon entropy is a property that can be imputed to a source independent of any channel)