News for hackers. Stuff that matters.

A comment on Mitochondria Are Alive. Parent comment

Re:Mitochondria Are Alive by satvikpendem on Friday November 08, 2024 @08:01PM (#42091745)
You don't know what the training data is and what each category's weights are, so how can you assume that?
[ Parent | on HN ]
Re:Mitochondria Are Alive by dekhn on Friday November 08, 2024 @08:07PM (#42091776)
Most use common crawl, and most seem to upweight the scientific publication part of it (from what I gather speaking to folks who train LLM models).
[ Parent | on HN ]