Re:Shannon Entropy Imposes Fundamental Limits on Communication
by mnks on Wednesday September 07, 2022 @09:02PM
(#32759666)
I wrote a blog post [1] with an interactive widget where you can provide an encoding for a random decimal digit and see how close you can get to the theoretical log₂(10) ≈ 3.32 bits.
[1]: https://blog.kardas.org/post/entropy/ (Average Code Length section)