News for hackers. Stuff that matters.
Re:Forecasting with Trees (2021) by bradhilton on Wednesday March 06, 2024 @12:27PM (#39618351)
Absolutely, you should look at XGBoost, LightGBM, and CatBoost.

XGBoost is the og and the most feature-rich.

LightGBM is the fastest and what I use for my case (millions of rows of data with over 100 features).

CatBoost could be good depending on the nature of your data, for example if you have a lot of categorical types.

EDIT: Alos, they all support GPU training, but I haven't been able to make that faster than just using more CPU cores.

Re:Forecasting with Trees (2021) by wongarsu on Wednesday March 06, 2024 @12:34PM (#39618436)
To add to that, I'd primarily consider LightGBM if you want to tweak it a lot, and CatBoost if you want great out-of-the-box results. Both are significant improvements over XGBoost, especially in training speed. I would only really consider XGBoost if you don't want software primarily developed by either Microsoft or Yandex.

All three are lightyears ahead of naive random forest implementations, and are in very active development.

Re:Forecasting with Trees (2021) by iambateman on Wednesday March 06, 2024 @12:55PM (#39618704)
Super helpful, thank you!
Re:Forecasting with Trees (2021) by iambateman on Wednesday March 06, 2024 @12:55PM (#39618699)
Very, very helpful – thanks Brad!
Re:Forecasting with Trees (2021) by bdjsiqoocwk on Thursday March 07, 2024 @02:48AM (#39626307)
Exactly what's the problem with sci-kit's random forest?