News for hackers. Stuff that matters.
Re:Why do tree-based models still outperform deep learning o... by redox99 on Tuesday March 05, 2024 @11:25AM (#39605667)
In what way have models gotten better for tabular data? Can't think of any new technique since 2022.
Re:Why do tree-based models still outperform deep learning o... by jeffreyrogers on Tuesday March 05, 2024 @12:17PM (#39606403)
There has been some work on training on lots of different data sets and then specializing on the one you care about. But I think people were trying that approach pre-2022 as well.
Re:Why do tree-based models still outperform deep learning o... by asdff on Tuesday March 05, 2024 @03:23PM (#39608749)
This has to be done with great care. Most datasets are of poor quality.
Re:Why do tree-based models still outperform deep learning o... by frituur on Tuesday March 05, 2024 @12:38PM (#39606699)
Do you have some good scientific references for that? I'd love to incorporate them in my phd thesis!
Re:Why do tree-based models still outperform deep learning o... by jeffreyrogers on Tuesday March 05, 2024 @02:16PM (#39607960)
Sorry, I don't have references off the top of my head. I just recall coming across it while I was working on something related to timeseries forecasting.
Re:Why do tree-based models still outperform deep learning o... by _pastel on Tuesday March 05, 2024 @02:56PM (#39608435)
Tooling around embeddings has improved. Creating and fine-tuning custom embeddings for your tabular data should be easier and more powerful these days.