News for hackers. Stuff that matters.

A comment on Amazon Chronos: Learning the Language of Time Series. Parent comment

Re:Amazon Chronos: Learning the Language of Time Series by wenc on Saturday March 23, 2024 @11:03AM (#39800453)
Dropout is different from ensembles. It is a regularization method.

It might look like an ensemble because you’re selecting different subsets but ensembles combine different independent models rather than just subset models.

[ Parent | on HN ]
Re:Amazon Chronos: Learning the Language of Time Series by wenc on Saturday March 23, 2024 @01:48PM (#39801727)
That said random forests are an internal ensemble, so I guess that could work.

In my mind an ensemble is like a committee. For it to be effective, each member should be independent (able to pick up different signals) and have a greater than random chance of being correct.

[ Parent | on HN ]
Re:Amazon Chronos: Learning the Language of Time Series by hackerlight on Saturday March 23, 2024 @11:20PM (#39804918)
I am aware it is not literally an ensemble model, but Geoffrey Hinton says it achieves the same thing conceptually and practically.
[ Parent | on HN ]