News for hackers. Stuff that matters.
Re:Forecasting with Trees (2021) by tigerlily on Wednesday March 06, 2024 @04:01AM (#39613849)
Anyone know of any practical ways to get started with this?
Re:Forecasting with Trees (2021) by felixleungsc on Wednesday March 06, 2024 @04:29AM (#39614026)
Maybe check out this recap on the M5 competition? It has links to notebooks and some of the top solutions.

https://www.kaggle.com/competitions/m5-forecasting-accuracy/...

Re:Forecasting with Trees (2021) by hackerlight on Wednesday March 06, 2024 @04:42AM (#39614110)
Kaggle.com. Sign up to a competition or download a dataset.

Install python 3.11, and the libraries sklearn, lightgbm, pandas, matplotlib and numpy

Ask a LLM to write a python script that loads the data and fits a model to the data and summarizes/plots some results.

Jupyter Lab with autoreload, and using a python virtual environment are recommended.

Re:Forecasting with Trees (2021) by schattschneider on Wednesday March 06, 2024 @04:45AM (#39614129)
Here is a short intro on the theory of Gradient Boosted Decision Trees: https://developers.google.com/machine-learning/decision-fore...

And here is a practical intro to it, you can run it right in your browser if you open it in Colab: https://www.tensorflow.org/decision_forests/tutorials/beginn...

Re:Forecasting with Trees (2021) by abhgh on Wednesday March 06, 2024 @08:44AM (#39615873)
If you're talking about Gradient Boosting, I've a somewhat popular answer on Quora from ages ago [1].

[1] https://qr.ae/pKJPbm

Re:Forecasting with Trees (2021) by iambateman on Wednesday March 06, 2024 @09:19AM (#39616186)
i'm using this tutorial to get started: https://www.youtube.com/watch?v=Wqmtf9SA_kk
Re:Forecasting with Trees (2021) by mnky9800n on Wednesday March 06, 2024 @10:17AM (#39616846)
I used to be an xgboost bro but these days I'm schilling for catboost. Anyways both have lots of examples online. The truth is without a problem interesting to you there's not much reason to learn about them unless you simply find gradient boosting algorithm elegant. Otherwise I would take some intro to machine learning course.
Re:Forecasting with Trees (2021) by bdjsiqoocwk on Thursday March 07, 2024 @02:47AM (#39626298)
> used to be an xgboost bro

You sound like a moron.

Re:Forecasting with Trees (2021) by mnky9800n on Thursday March 07, 2024 @05:40AM (#39627379)
Thanks internet stranger.
Re:Forecasting with Trees (2021) by ianspektor on Thursday March 07, 2024 @12:22PM (#39631640)
(temporian developer here)

Here's a simplified version of the approach (i.e. performing strong feature engineering, then converting the multivariate time series data to a panel/tabular dataset and training a boosting trees model on it), using temporian (a much improved alternative to pandas for working with temporal data) and xgboost: https://temporian.readthedocs.io/en/stable/tutorials/m5_comp...