News for hackers. Stuff that matters.
Re:"The Bitter Lesson" is wrong. Well sort of by aabhay on Sunday July 20, 2025 @03:37PM (#44628580)
Transfer learning isn’t about “exhausting” all available un-curated data, its simply that the systems are large enough to support it. There’s not that much of a reason to train on all available data. And its not all, there’s still a very significant filtration happening. For example they don’t train on petabytes of log files, that would just be terribly uninteresting data.

There are no comments on this comment yet.