Re:FineWeb: Decanting the web for the finest text data at scale
by sieszpak on Monday June 03, 2024 @06:58AM
(#40561401)
The article contains a recipe worth millions of dollars. And there's silence in the comments... why?
[ Parent
| on HN ]
Re:FineWeb: Decanting the web for the finest text data at scale
by bckr on Monday June 03, 2024 @08:13AM
(#40561910)
Takes time to read and evaluate something of high quality.
Likely some good blog posts will come out and get posted here in the coming days / weeks evaluating and summarizing.
Re:FineWeb: Decanting the web for the finest text data at scale
by montebicyclelo on Monday June 03, 2024 @07:22AM
(#40561572)
Yep interesting that massively useful and impactful work like this doesn't seem to get as much interest on HN compared to gimicky new architectures that have only been shown work well only on tiny datasets like MNIST and CIFAR, rather than at scale.
Re:FineWeb: Decanting the web for the finest text data at scale
by baobabKoodaa on Tuesday June 04, 2024 @07:59AM
(#40573534)
Filtering datasets is not the flashiest and shiniest part of the AI ecosystem, so I'm not surprised it doesn't evoke strong emotions or lots of comments.