Re:33TB of text data for a 1T-parameter model
by z3c0 on Sunday April 16, 2023 @11:46AM
(#35591037)
The web crawling is curation, as even the most mundane entries into the dataset will still have a significant weight on the model, even if it's small. What separates the brain from any statistics-driven model is how well it swims through an ocean of information to find the relevant details, tossing out what's left, and filling in gaps with intuition. Sure, its messy process, and mistakes get made, but that's in stark contrast to the very trim way that ML models run.
[ Parent
| on HN ]
There are no comments on this comment yet.