News for hackers. Stuff that matters.
Re:Why decision trees is the best data mining algorithm by iskander on Tuesday June 14, 2011 @09:21AM (#2652827)
Decision trees suffer from high variance. A slightly different sample might give you entirely different splits; using decision trees for data interpretation or feature selection is an art at best (and for some data sets uselessly unreliable).

>Decision trees are weak learners.

This is untrue. They're only used as weak learners in boosting because the tree depth is limited to some small constant.

>Decision trees run fast even with lots of observations and variables

I don't know all the decision tree learning algorithms, but at least some of the common ones run in O(features * samples * splits). That's not terrible, but you can handle much larger data sets optimizing w/ stochastic gradient descent or coordinate descent.

>Decision trees can easily handle unbalanced datasets.

This links to a post about bagging, which is not really specific to decision trees (but can be done with any learning algorithm)

There are no comments on this comment yet.