Re:The often-overlooked random forest kernel
by j2kun on Sunday October 29, 2017 @08:16PM
(#15582336)
Do you have any insights as to why random forests are better (are they better?) in this context (or any context?) than boosted decision trees?
[ Parent
| on HN ]
Re:The often-overlooked random forest kernel
by RMarcus on Monday October 30, 2017 @12:00AM
(#15583014)
I've done no experiment, but I predict a boosted forest would perform poorly here. Since the first tree learns the majority of the information (and each of the following trees only fits the errors, and are therefore less "meaningful"). Since the kernel approach suggested here weights all the trees equally, the results probably won't be as good. Maybe if you gave the first trees more weight, though...