News for hackers. Stuff that matters.
Re:What Is Entropy? by waveBidder on Monday July 22, 2024 @08:05PM (#41041142)
that's actually the normal view, with saying both info and stat mech entropy are the same is an outlier, most popularized by Jaynes.
Re:What Is Entropy? by kmeisthax on Monday July 22, 2024 @11:29PM (#41042253)
If information-theoretical and statistical mechanics entropies are NOT the same (or at least, deeply connected) then what stops us from having a little guy[0] sort all the particles in a gas to extract more energy from them?

[0] https://en.wikipedia.org/wiki/Maxwell%27s_demon

Re:What Is Entropy? by xdavidliu on Tuesday July 23, 2024 @10:34AM (#41046390)
Sounds like a non-sequitur to me; what are you implying about the Maxwell's demon thought experiment vs the comparison between Shannon and stat-mech entropy?