Re:Why do tree-based models still outperform deep learning o...
by coffee_am on Friday August 05, 2022 @08:24AM
(#32355084)
One way is to use categorical set splits [1] (proposed for categorical set inputs, but works for categorical features as well), used in TF-DF [1]. Greedy, and expensive to train (cheap inference though), but it gives great results.
[1] https://arxiv.org/pdf/2009.09991.pdf [2] https://www.tensorflow.org/decision_forests/text_features