Re:Why do tree-based models still outperform deep learning o...
by Scene_Cast2 on Tuesday March 05, 2024 @12:00PM
(#39606201)
Inference speed: more sophisticated stacks use multiple stages. Early stage might be a sublinear vector search, and the heavy hitting neural nets only rerank the remainder. Bytedance has a paper on their fairly fancy sublinear approach.
Retraining - online training solves this for the most part.
Frameworks - the only battle-tested batteries-included one I've seen is Vespa. Noone else publishes any of interesting bits. KDD is the most relevant conference if you're interested in the field. IIRC Xiaohongshu has some papers that can only really be done with NNs.
PS: Its weird that you are being down-voted. I think your opinion is reasonable.