News for hackers. Stuff that matters.
Re:Regularization is all you need: simple neural nets can ex... by mandelken on Tuesday June 22, 2021 @04:25PM (#27596741)
GBDT have their own set of hyperparameters such as learning rate, number of trees, min samples per bin, l0, l1, etc. So you could definitely also create an appropriate cocktail to optimize on, although GBDT are typically more robust wrt huperparameters.
Re:Regularization is all you need: simple neural nets can ex... by nightcracker on Tuesday June 22, 2021 @04:32PM (#27596818)
The authors do claim to do a hyperparameter sweep but only for vanilla XGB hyperparams.
Re:Regularization is all you need: simple neural nets can ex... by civilized on Tuesday June 22, 2021 @09:43PM (#27599792)
The old "my method (with as much optimization as I could get away with) beats the other method (with as little optimization as I could get away with)"
Re:Regularization is all you need: simple neural nets can ex... by disgruntledphd2 on Wednesday June 23, 2021 @09:39AM (#27604446)
Yup. The Least Publishable Unit strikes again.