News for hackers. Stuff that matters.
Re:Entropy explained, with sheep (2016) by roimor on Saturday August 15, 2020 @05:29PM (#24172576)
I'm referring to the entropy of the Bernoulli distribution. If the coin is fair, the entropy is 1 bit... if the coin isn't fair, then the entropy of the distribution is less than 1 bit. I'm having trouble reconciling the information theory way of thinking about entropy as a function of a distribution, with how physicists tend to think of entropy of arrangements.
Re:Entropy explained, with sheep (2016) by kgwgk on Sunday August 16, 2020 @08:01AM (#24177095)
There is a relationship between the distribution of x_i and the sequences generated from that distribution x_1, x_2, ..., x_n. If the coin isn't fair there are less arrangements possible. If the coin has two heads there is only one possible sequence.