Re:A Tour of the Top Algorithms for Machine Learning Newbies
by bunderbunder on Tuesday October 30, 2018 @01:55PM
(#18339467)
Sorry, I misspoke - will edit. Was talking about resistance to overfitting. Which largely comes from logistic regression's assumption of a linear decision boundary. It's true surprisingly often in classification tasks, and, when it's not, you can usually model it just fine with interaction variables.
With an ANN, your easiest defense against overfitting is to have great big heaping piles of training data. That's something that's hard to come by in many interesting situations.
Re:A Tour of the Top Algorithms for Machine Learning Newbies
by polkapolka on Tuesday October 30, 2018 @03:06PM
(#18340260)
Agreed. Logistic regression with poly kernel or good engineering interactions can equal or beat more complex models for a fraction of the budget.
All the more power to you if a solid simple logreg model (or even no ML at all) is your first deliverable.
Re:A Tour of the Top Algorithms for Machine Learning Newbies
by tomrod on Tuesday October 30, 2018 @02:26PM
(#18339842)
Would you mind talking to how black box interpretability is becoming well known? I've seen Shapley values used for feature interpretation, but not sure what else is being done.
Re:A Tour of the Top Algorithms for Machine Learning Newbies
by polkapolka on Tuesday October 30, 2018 @02:58PM
(#18340173)
For an accessible recent overview see: https://christophm.github.io/interpretable-ml-book/
Logistic regression is high bias low variance. If you were talking about fairness bias, then resistance to bias comes from logreg being too dumb to recognize complex non-linear patterns. Not necessarily a pro.