News for hackers. Stuff that matters.
Re:Shannon’s Source Coding Theorem (Foundations of Informati... by teleforce on Sunday June 18, 2023 @03:53PM (#36383795)
Shannon is such an engineering marvel as Einstein is for science. His perennial works, hobbies, papers and theses outlined the fundamentals of modern engineering foundations including digital, computer and communication systems including AI systems of early forms of chess engine, LLM, etc [1]. Kleinrock once noted that he has to pursue exotic field of queuing theory that led to packet switching and then Internet, because most of popular problems in his research field have been solved by Shannon (who was also one of Kleinrock's doctoral research study committee members).

[1]How Claude Shannon Helped Kick-start Machine Learning:

https://www.spectrum.ieee.org/claude-shannon-information-the...

Re:Shannon’s Source Coding Theorem (Foundations of Informati... by 082349872349872 on Sunday June 18, 2023 @05:42PM (#36384815)
I'm fond of his "mind-reading machine": https://literateprograms.org/mind_reading_machine__awk_.html

(compare Agassi/Becker for the value of single-bit predictions)

Re:Shannon’s Source Coding Theorem (Foundations of Informati... by metadat on Sunday June 18, 2023 @06:33PM (#36385224)
Wow, what a fascinating concept and read. It's humbling to consider and marvel at what early technology pioneers like Claude Shannon envisioned and accomplished with a tiny, miniscule sliver of computational power compared to what we are surrounded by today.

I couldn't resist submitting it, especially considering it has not yet been discussed on HN*:

https://news.ycombinator.com/item?id=36385198

(*A different link covering the same subject was submitted 6 years ago but never caught on: https://news.ycombinator.com/item?id=14450232)