News for hackers. Stuff that matters.
Re:Yandex open sources CatBoost, a gradient boosting ML library by kgwgk on Tuesday July 18, 2017 @11:06AM (#14797084)
> gradient boosting — the branch of ML that is specifically designed to help “teach” systems when you have a very sparse amount of data, and especially when the data may not all be sensorial (such as audio, text or imagery), but includes transactional or historical data, too.

That's some strange definition.

Re:Yandex open sources CatBoost, a gradient boosting ML library by mjn on Tuesday July 18, 2017 @11:50AM (#14797478)
Weird, yeah. Seems like a roundabout way of trying to preemptively answer the "why not deep learning?" question omnipresent among ML newcomers. The bits identified aren't really wrong: you could argue that gradient boosting's comparative strength is that it works well (often out-of-the-box, with little tuning) on structured data sets, including relatively small data sets. Hence the good performance on Kaggle-type problems, whereas deep learning is ahead in audio/text/image/video data; and hence the lack of gradient boosting being used on ImageNet-type problems.

But these points all belong in some section entitled "why use gradient boosting instead of another ML method?", not in a definition of gradient boosting.

Re:Yandex open sources CatBoost, a gradient boosting ML library by daddyo on Tuesday July 18, 2017 @02:56PM (#14799109)
Seems that deep learning can benefit from gradient boosting too (at least, from a computational perspective).

https://arxiv.org/abs/1706.04964 "Learning Deep ResNet Blocks Sequentially using Boosting Theory"

(As for the lay-man description: I thought boosting performed better out-of-the-box on dense data than on sparse data, because most feature sub-selections for bagging are on zero'd features)