News for hackers. Stuff that matters.
Re:A working entropy encoder with output below the Shannon l... by foobarqux on Monday June 24, 2024 @07:23PM (#40782247)
I think you are confused about probabilities and realized frequencies. A probability is a before-the-fact model. A realized frequency is an after the fact observation. If you flip a fair coin the probability of heads or tails is 50% but any given single flip will have a frequency of 1 for either heads or tails and 0 for the other. (What is true is that as you flip the coin a very large number of times the actual ratio you will see will approach 50/50 but that's definitely not true for say 8 tosses. This is called the asymptotic equipartition principle but it isn't really relevant here).

There are no comments on this comment yet.