Why do tree-based models still outperform deep learning on tabular data?

Re:Why do tree-based models still outperform deep learning o... by laichzeit0 on Thursday August 04, 2022 @04:23AM (#32340536)

This is how I see it:

Statistical modeling: input -> feature extraction (manual) -> model selection (manual) -> output

Machine learning: input -> feature extraction (manual) -> model selection (auto) -> output

Deep learning: input -> feature extraction (auto) -> model selection (auto) -> output

So take a DL image classifier. The convolution + pooling layers perform automatic feature extraction. Back to OPs point, why use something like DL when you've already engineered your features?

[ Parent | on HN ]

Re:Why do tree-based models still outperform deep learning o... by wpietri on Thursday August 04, 2022 @11:19AM (#32344071)

Wow, what a good summary. Thanks!

[ Parent | on HN ]