Re:Information Theory, Inference, and Learning Algorithms (f...
by Eliezer on Thursday October 01, 2009 @06:20AM
(#854652)
Jaynes died before he finished it. It's still one of the most important books I ever read.
Re:Information Theory, Inference, and Learning Algorithms (f...
by yaroslavvb on Wednesday September 30, 2009 @04:33PM
(#853608)
It's good, with a heavy focus on frequentist statistics and maximum entropy approach
Re:Information Theory, Inference, and Learning Algorithms (f...
by mreid on Wednesday September 30, 2009 @06:51PM
(#853910)
I think to say the book has a heavy focus on frequentist statistics is a little misleading. Jaynes discusses a lot of frequentist methods but the emphasis is on doing so from a very Bayesian point of view.
Re:Information Theory, Inference, and Learning Algorithms (f...
by yaroslavvb on Saturday October 03, 2009 @06:43PM
(#859330)
He uses Bayesian methods in some cases, and non-Bayesian method in others. For instance on page 1412 he describes a problem for which Bayesian methods are "not appropriate."
http://omega.albany.edu:8008/ETJ-PS/cc14g.ps
This is a bit of an anathema to purist Bayesians like Radford Neal who say that Jaynes Maximum Entropy method is not consistent with Bayesian methods and that it "doesn't make any sense"
http://groups.google.com/group/sci.stat.consult/msg/2cf57ceb...
Re:Information Theory, Inference, and Learning Algorithms (f...
by Herring on Wednesday September 30, 2009 @04:24PM
(#853579)
More long winded than most, but it's normal "physics" writing. Very clear. I recommend the preface whether or not you intend to read the whole thing.
Re:Information Theory, Inference, and Learning Algorithms (f...
by RyanMcGreal on Wednesday September 30, 2009 @04:01PM
(#853513)
It's probably pretty good. (Sorry.)
Can anyone comment on the quality of the writing?