News for hackers. Stuff that matters.
Re:Journey into Information Theory by beagle3 on Monday June 08, 2015 @11:58AM (#9679906)
Shannon's original paper, titled "A Mathematical Theory of Communication"[0] which basically founded Information Theory as its own coherent and well defined field is also very readable. Some of the concepts were well known before he published it, some were original -- but the coherent formulation, notation and concentration in that paper is what established the field now known as "Information Theory".

[0] http://worrydream.com/refs/Shannon%20-%20A%20Mathematical%20...

Re:Journey into Information Theory by gshrikant on Monday June 08, 2015 @12:52PM (#9680346)
Thanks for pointing me to http://worrydream.com/refs. It is a treasure trove of wonderful writings!
Re:Journey into Information Theory by gshrikant on Monday June 08, 2015 @04:10AM (#9677790)
I found Hartley's paper [1] (also discussed in the video sequence) on quantifying information surprisingly accessible and a good read in general.

[1] http://www.dotrose.com/etext/90_Miscellaneous/transmission_o...

Re:Journey into Information Theory by anirudt on Monday June 08, 2015 @04:52AM (#9677912)
Elements of Information Theory, by Thomas Cover is also a very good read for fundamentals.
Re:Journey into Information Theory by stared on Monday June 08, 2015 @01:29PM (#9680650)
By J. Thomas AND Thomas Cover. Even worse combination than Stephan-Boltzmann law or Albert-Barabasi networks.

The book itself is great, IMHO the best intro to information theory and entropy.

Re:Journey into Information Theory by murbard2 on Monday June 08, 2015 @10:12AM (#9679157)
"History of the alphebet" [sic]

Not mentioned is the curious fact that there seems to have been only one independent discovery of the alphabet. All alphabets are descended from the same root, proto-sinaitic or have been made up by people who knew about alphabets (Korean). Irish runes and Khmer script thus share a common ancestor.

Re:Journey into Information Theory by mrcactu5 on Monday June 08, 2015 @02:54PM (#9681355)
I think it's insane that Khan Academy should attempt to cover information theory giving the Coursera course has a 1% passing rate.

I am two videos in, biting my lip to not make technical comments that don't matter at this level. They do a great job of simplifying a very complex subject.

Re:Journey into Information Theory by yen223 on Monday June 08, 2015 @06:17AM (#9678121)
Information Theory is one of my most favourite courses that I took at uni. The idea that you can take something as abstract as "information", and quantify it in a useful manner was eye-opening.
Re:Journey into Information Theory by bandrami on Monday June 08, 2015 @11:04AM (#9679530)
Same here. Particularly the idea that "information" and "entropy" are the same quantity. That was an eye-opener.