Introduction to Decision Tree Learning

Re:Introduction to Decision Tree Learning by ishansharma on Thursday April 26, 2018 @11:55AM (#16933013)

Hi,

Author here. Thanks for the links. I originally planned to try a bigger dataset but didn't want to make the article too long, so left out the optimizations.

I had to do the same exercise for my ML class and had similar results. Random pruning (mostly) worked great for me.

IMHO, While DTs do overfit a lot, they are a great starting point for beginners because of their (relative) simplicity. Better to start light and then introduce the math heavy neural nets and SVMs.

[ Parent | on HN ]

Re:Introduction to Decision Tree Learning by abhishekjha on Thursday April 26, 2018 @12:57PM (#16933592)

I don’t know why but I felt regression to be a very easy starting point. y = mx + c is just high school math.

[ Parent | on HN ]

Re:Introduction to Decision Tree Learning by mliswhat on Thursday April 26, 2018 @12:04PM (#16933109)

Thanks for stopping by the thread. I'm doing my thesis in regression trees and appreciate any love trees get in the ML space. I quite liked the article, but my only comment is that the pseudo-code for ID3 was a little hard for me to read formatting wise.

[ Parent | on HN ]

Re:Introduction to Decision Tree Learning by ishansharma on Thursday April 26, 2018 @12:12PM (#16933178)

Ah, I guess I could have used a Gist for that. Thanks for the suggestion, let me see if I can update the article.

[ Parent | on HN ]

Re:Introduction to Decision Tree Learning by jrumbut on Thursday April 26, 2018 @06:56PM (#16936727)

Hey, great explanation of decision trees. I might recommend, instead of going for a bigger dataset, maybe following it up by adding bagging or boosting.

Fairly often people writing tutorials jump straight to Random Forest or Gradient Boosting, and those are great to use but maybe too big a conceptual leap to understand straight away if your theoretical background is weak.

[ Parent | on HN ]

Re:Introduction to Decision Tree Learning by ishansharma on Friday April 27, 2018 @08:15AM (#16940182)

Thank you. I will consider doing that. I will have to create or find a relevant dataset that's small enough for those concepts but I guess that'll help rather than jumping straight to random forest or gradient boosting.

[ Parent | on HN ]