News for hackers. Stuff that matters.
Re:Training great LLMs from ground zero by llm_trw on Wednesday March 06, 2024 @07:45PM (#39623736)
>Yet overall, this seems like a massive, energy intensive exercise in redundancy.

Keep in mind that this is also chaff to distract people from the real secret sauce. I imagine that just as many startups are hiring writers and photographers to create extremely well labelled uncontaminated data for training.

One only need to look at the perverts over at civitai to see how far you can go with intensive labeling on a tiny compute budget.

Re:Training great LLMs from ground zero by fennecbutt on Thursday March 07, 2024 @12:50PM (#39632132)
Us furries were properly tagging data on e6 for a long time before LLMs came about.