News for hackers. Stuff that matters.
Re:Ilya Sutskever's SSI Inc raises $1B by whimsicalism on Wednesday September 04, 2024 @03:45PM (#41449881)
i think we should distinguish between pretraining and polishing/alignment data. what you are describing is most likely the latter (and probably mixed into to pretraining). but if you can't get a mass of tokens from scraping, you're going to be screwed

There are no comments on this comment yet.