News for hackers. Stuff that matters.
Re:Think Stats: Probability and Statistics for Programmers by tokenadult on Sunday August 28, 2011 @01:49PM (#2934478)
My favorite references on statistics get to an idea that I think you will be inclined to emphasize: DATA is what matters in statistics, more than mathematical manipulation. See what you think about these, and best wishes for further revisions of your interesting online guide.

http://statland.org/MAAFIXED.PDF

The first link is a BEAUTIFUL and thought-provoking discussion of what's dangerous about having a new mathematics professor choose the statistics textbooks for an introductory college class in statistics, with advice on what to look for in statistics textbooks.

http://escholarship.org/uc/item/6hb3k0nz

The second link is by a very famous statistician, with discussion of how the statistics curriculum could be revised to better emphasize the most important ideas.

Put the key ideas from these two resources in your own words, and you will have a good guide to programmers about how to think about statistics.

Re:Think Stats: Probability and Statistics for Programmers by AllenDowney on Sunday August 28, 2011 @03:39PM (#2934727)
Very interesting. I certainly agree with the idea from the first article, on the importance of data, and from the second article, on the usefulness of simulation.
Re:Think Stats: Probability and Statistics for Programmers by AllenDowney on Monday August 29, 2011 @09:35PM (#2939761)
I read the first article more carefully, and it inspired this new blog post: http://allendowney.blogspot.com/2011/08/jimmy-nut-company-pr...
Re:Think Stats: Probability and Statistics for Programmers by mofeeta on Monday August 29, 2011 @03:02PM (#2938359)
Your second link was an eye-opener. Can you recommend any textbooks or an online class (or its remains) that teaches Cobb's recommended curriculum?
Re:Think Stats: Probability and Statistics for Programmers by tokenadult on Monday August 29, 2011 @06:02PM (#2939244)
Cobb, in some writing of his, recommends the textbook Statistics: Learning in the Presence of Variation,

http://www.amazon.com/Statistics-Learning-Presence-Variation...

which I bought just more than three years ago after I read that. The textbook is quite thought-provoking, not just another Tweedledum to the usual Tweedledee of undergraduate statistics textbooks.

Re:Think Stats: Probability and Statistics for Programmers by mofeeta on Tuesday August 30, 2011 @07:39AM (#2940984)
Thanks, I'll check it out. It looks like he has authored a couple of stats books, too, that might be worthwhile.
Re:Think Stats: Probability and Statistics for Programmers by JeanPierre on Sunday August 28, 2011 @02:15PM (#2934548)
If you've gone through this book and want to learn more ways to use statistics and probability, you should look at the videos from mathematicalmonk[1] on youtube - he's like Khan for Machine Learning and more rigorous probability. It helps learning Machine Learning and Hidden Markov Models pretty well, at least from my experience.

http://www.youtube.com/user/mathematicalmonk

Re:Think Stats: Probability and Statistics for Programmers by tathagatadg on Sunday August 28, 2011 @08:27PM (#2935392)
Awesome .. just what I was looking for!
Re:Think Stats: Probability and Statistics for Programmers by mvzink on Sunday August 28, 2011 @03:07PM (#2934654)
Who's going try reading some of this before doing the ML or AI Stanford courses?
Re:Think Stats: Probability and Statistics for Programmers by timruffles on Sunday August 28, 2011 @03:15PM (#2934674)
Very much so. Still trying to find out exactly what maths will be required, I'm looking at things from related courses http://see.stanford.edu/see/courses.aspx.
Re:Think Stats: Probability and Statistics for Programmers by kanwisher on Sunday August 28, 2011 @03:50PM (#2934753)
Hah funny same here, trying to beef up stats and linear algebra. Quite excited about the ML Class.
Re:Think Stats: Probability and Statistics for Programmers by edtechre on Sunday August 28, 2011 @05:26PM (#2935026)
That's partly why I bought it. My university didn't have a statistics department, so I never had the chance to take a statistics course that was worthwhile.

Statistics and linear algebra really should be required by all CS programs. It's funny that at many schools those courses are not, yet Calculus is. First, Calculus should have been handled in HS. Second, I've never had a use for Calculus professionally or for anything I've worked on in my free time.

Re:Think Stats: Probability and Statistics for Programmers by stiff on Monday August 29, 2011 @03:13AM (#2936284)
Calculus is a major prerequisite for both a reasonably serious statistics course, and for a reasonably serious AI/ML course. Furthermore, at least for ML it is multi-variable calculus based on linear algebra, I doubt you could learn this in high school at the level needed.
Re:Think Stats: Probability and Statistics for Programmers by edtechre on Sunday August 28, 2011 @05:26PM (#2935027)
And on that note, does anyone have any other good book suggestions regarding ML?
Re:Think Stats: Probability and Statistics for Programmers by maurits on Sunday August 28, 2011 @06:21PM (#2935167)
Of the top of my head,

- Machine Learning by Tom M Mitchell http://www.cs.cmu.edu/~tom/mlbook.html

For general reading and introductions I also like:

- Pattern Classification by Richard Duda

- Pattern Recognition and Machine Learning by Christopher Bishop

For a bit more emphasis on statistics and math, I usually dive in to

- Classification,Parameter Estimation and State Estimation by van der Heijden

And last, but certainly not least:

- Information Theory, Inference, and Learning Algorithms by David MacKay, available here:

http://www.inference.phy.cam.ac.uk/mackay/itila/

Re:Think Stats: Probability and Statistics for Programmers by edtechre on Monday August 29, 2011 @12:42AM (#2935960)
Excellent, many thanks.

I've read O'Reilly's Collective Intelligence. It's a great introductory survey, but it was very light on theory.

I also own Collective Intelligence in Action. It had more explanation of theory than O'Reilly's offering, but most of the chapters devolved into how to use Java data mining framework X.

Re:Think Stats: Probability and Statistics for Programmers by DanielRibeiro on Sunday August 28, 2011 @01:12PM (#2934351)
No mention of Z-test at all[1]? Guess, at least for hypothesis testing, Wikipedia did a more comprehensive job[2]

[1] http://en.wikipedia.org/wiki/Z-test

[2] http://en.wikipedia.org/wiki/Statistical_hypothesis_testing

Re:Think Stats: Probability and Statistics for Programmers by AllenDowney on Sunday August 28, 2011 @03:30PM (#2934715)
Rather than get into a catalog of tests, I take the approach that "There is only one test." I wrote more about it here: http://allendowney.blogspot.com/2011/05/there-is-only-one-te...
Re:Think Stats: Probability and Statistics for Programmers by Jach on Sunday August 28, 2011 @09:27PM (#2935532)
Furthermore, another reason the entire classic test-based approach is bad since it encourages having binary hypotheses when many real-world problems don't, they may be many or composite or even infinite. (Of course, many real-world problems can be reduced to binary ones, which is one reason the approach became popular.)

If you know enough probability theory, statistics is just a special case. The nice thing about using probability theory is if you do decide to use a 'test', all of your assumptions are put forth first. As E.T. Jaynes says:

    In estimating a location parameter, for example, the sample median M is often cited as
    a more robust estimator than the sample mean. But here it is obvious that this
    ‘robustness’ is bought at the price of insensitivity to much of the relevant
    information in the data. Many different data sets all have the same
    median; the values above or below the sample median may be moved about arbitrarily
    without affecting the estimate. Yet those data values surely contain information
    highly relevant to the question being asked, and all this is lost. We would have
    thought that the whole purpose of data analysis is to extract all the information
    we can from the data.
    
    Thus, while we agree that robust/resistant properties may be desirable in some cases,
    we think it important to emphasize their cost in performance. In the literature,
    ad hoc procedures have been advocated on no more grounds than that they are ‘robust’
    or ‘resistant’, with no mention of the quality of the inference they deliver, much
    less any comparison of performance with alternative methods; yet alternative methods
    such as Bayesian ones are criticized on grounds of lack of robustness,
    without any supporting factual evidence.
A recent probability book I've started that I think is pretty good is http://uncertainty.stat.cmu.edu/
Re:Think Stats: Probability and Statistics for Programmers by edtechre on Sunday August 28, 2011 @05:16PM (#2934998)
Great book. But I made the mistake of buying this book on Kindle just a few hours before I saw it show up here.

:(

Re:Think Stats: Probability and Statistics for Programmers by AllenDowney on Monday August 29, 2011 @08:36AM (#2936916)
Sorry! It's really not meant to be a trick. The book is under a CC license. I provide the PDF version at Green Tea Press, the LaTeX source for anyone who wants to make a modified version, and a not very good HTML version (some of the math is broken). O'Reilly provides the printed and Kindle versions.

Right now all versions have the same content, but I will continue to revise, so you can think of the version on Green Tea Press as the draft of the second edition.

I know it can be confusing, but I hope the benefits of the free license make up for it.

Re:Think Stats: Probability and Statistics for Programmers by lylejohnson on Monday August 29, 2011 @09:55PM (#2939800)
Thanks for the clarification, Allen. It's a great tutorial, I was glad to pay for it, and I will be recommending it to others!
Re:Think Stats: Probability and Statistics for Programmers by mahmud on Sunday August 28, 2011 @11:28PM (#2935782)
Green Tea Press are good guys, I would never feel sorry for paying them; they have done far more for humanity than my $30 ever will: http://greenteapress.com/
Re:Think Stats: Probability and Statistics for Programmers by lylejohnson on Sunday August 28, 2011 @11:40PM (#2935803)
I'm a little confused about the various editions. Just a few weeks ago I bought the "Think Stats" ebook published by O'Reilly (same author). Is it all the same content?
Re:Think Stats: Probability and Statistics for Programmers by rodh257 on Sunday August 28, 2011 @08:00PM (#2935343)
kindle native version should be much easier to read than trying to view html/pdf on the kindle, and you've supported the author