News for hackers. Stuff that matters.
Re:A high bias low-variance introduction to Machine Learning... by pure-awesome on Thursday August 16, 2018 @04:09AM (#17772816)
I get the idea that the title "High Bias, Low Variance" is some sort of reference or pun, but I'm not quite getting it...

I mean, I know that there's a bias-variance tradeoff in stats and ML, but what does it mean in the context of introduction to ML for physicists?

My guess is they mean they aren't going into as heavy detail in ML, which means the reader may lack some knowledge (high bias) but won't miss the forest/wood for the trees (low variance).

Anyone else care to speculate?

Re:A high bias low-variance introduction to Machine Learning... by gabrielgoh on Thursday August 16, 2018 @04:29AM (#17772934)
I guess the author is not claiming a well rounded (low bias) introduction to ML to statistics, but a highly biased and specialized (low variance) course that is tailored to the author's own interests and tastes.
Re:A high bias low-variance introduction to Machine Learning... by pure-awesome on Thursday August 16, 2018 @11:46AM (#17775662)
Quite possibly.
Re:A high bias low-variance introduction to Machine Learning... by tanilama on Thursday August 16, 2018 @05:11AM (#17773150)
High-bias, meaning it is opinionated from author's own perspective.

Low-variance, I think the author means to have a sharp and quality focus on the subjects he/she is going to talk about.

Re:A high bias low-variance introduction to Machine Learning... by yoquan on Thursday August 16, 2018 @05:17AM (#17773171)
Almost agree to what you said. Just a piece of more context: the 1st author wrote about connection between physics's Renormalization Group and Deep learning which was featured in [1] 4 years ago.

[1]: https://www.quantamagazine.org/deep-learning-relies-on-renor...

Re:A high bias low-variance introduction to Machine Learning... by pure-awesome on Friday August 17, 2018 @10:06AM (#17782897)
Seems the most plausible explanation to me, so far.
Re:A high bias low-variance introduction to Machine Learning... by ivan_ah on Thursday August 16, 2018 @06:32AM (#17773447)
Yeah after looking through the PDF, I'm still wondering what they meant. Here are some conjectures:

- The book has a high bias (since written from physics perspective), but low variance since assuming physics background allows authors to write a very focussed narrative that works for physicists (low variance on subset of physisicts readers).

- If we define the problem of choosing which topics t1, t2, ..., tn to cover in a ML book, the authors are saying the using the physicists approach will lead to consistency good results (i.e. not all over the place). It something like an argument from physicists-are-sensible people, unlike CS theoreticians, industry practicians, and mathematicians.

Re:A high bias low-variance introduction to Machine Learning... by aisofteng on Thursday August 16, 2018 @08:44AM (#17774106)
The reference is to the bias-variance tradeoff: https://en.wikipedia.org/wiki/Bias–variance_tradeoff
Re:A high bias low-variance introduction to Machine Learning... by pure-awesome on Thursday August 16, 2018 @11:46AM (#17775659)
Yes, I know. I mention that in my original comment.
Re:A high bias low-variance introduction to Machine Learning... by currymj on Thursday August 16, 2018 @12:59PM (#17776429)
I interpreted “high-bias” as meaning it has an idiosyncratic and specific audience, but “low variance” as meaning with high probability it will be an effective teaching tool for that audience.
Re:A high bias low-variance introduction to Machine Learning... by pure-awesome on Friday August 17, 2018 @10:07AM (#17782900)
Yeah, seems like a sane interpretation.
Re:A high bias low-variance introduction to Machine Learning... by currymj on Friday August 17, 2018 @03:45PM (#17785208)
all these different interpretations suggest that lots of people, myself included, have a fuzzier understanding of the bias-variance tradeoff than we'd care to admit.
Re:A high bias low-variance introduction to Machine Learning... by curious1212 on Thursday August 16, 2018 @11:09AM (#17775274)
my take on this: The high bias, low variance means that the models used in the book are the standard used in physic. The low variance means that the author doesn't use any artificial model or parameter except those that arise from physical considerations. Care is taken to motivate physically ML models and those far from physic can't be used with many parameters (hyperparameters).
Re:A high bias low-variance introduction to Machine Learning... by salty_biscuits on Thursday August 16, 2018 @09:11AM (#17774291)
The "model" presented for ML is low complexity, hence lives on the high bias, low variance side of the space of possible models.