News for hackers. Stuff that matters.
Re:The often-overlooked random forest kernel by j2kun on Sunday October 29, 2017 @08:16PM (#15582336)
Do you have any insights as to why random forests are better (are they better?) in this context (or any context?) than boosted decision trees?
Re:The often-overlooked random forest kernel by RMarcus on Monday October 30, 2017 @12:00AM (#15583014)
I've done no experiment, but I predict a boosted forest would perform poorly here. Since the first tree learns the majority of the information (and each of the following trees only fits the errors, and are therefore less "meaningful"). Since the kernel approach suggested here weights all the trees equally, the results probably won't be as good. Maybe if you gave the first trees more weight, though...
Re:The often-overlooked random forest kernel by j2kun on Tuesday October 31, 2017 @05:50PM (#15596899)
> Maybe if you gave the first trees more weight, though

That is exactly what boosting does...and one would weight the kernel computation in the same way.