News for hackers. Stuff that matters.

A comment on Machine Learning 101: An Intro to Utilizing Decision Trees. Parent comment

Re:Machine Learning 101: An Intro to Utilizing Decision Trees by drxzcl on Friday September 30, 2016 @03:56AM (#12611073)
The upside of teaching decision trees first is that it allows me to spot the people that dropped out of the online course after week one right away ;)

Seriously, I see an amazing amount of people that deploy basic vanilla decision trees (no boosting/bagging, no particular thought about features etc) without any real thought or reason. It has become one of my main "ML smells".

[ Parent | on HN ]
Re:Machine Learning 101: An Intro to Utilizing Decision Trees by matchagaucho on Friday September 30, 2016 @11:50AM (#12613180)
In m experience, 95% of DT optimization comes from pruning; not boosting/bagging.
[ Parent | on HN ]
Re:Machine Learning 101: An Intro to Utilizing Decision Trees by nl on Friday September 30, 2016 @07:14AM (#12611748)
How does someone use a DT without some feature engineering?

I mean - I like people who say they'd try a random forest first for a given problem because it's almost always a good answer.

But yes - feature engineering is almost always the difference then.

[ Parent | on HN ]