News for hackers. Stuff that matters.
Re:When ChatGPT Broke an Entire Field: An Oral History by Karrot_Kream on Thursday May 01, 2025 @08:13PM (#43864832)
Curious how big your dataset was if you used $1000 of GPU credits on DistilBERT. I've run BERT on CPU on moderate cloud instances no problem for datasets I've worked with, but which admittedly are not huge.
Re:When ChatGPT Broke an Entire Field: An Oral History by keyserj on Thursday May 01, 2025 @10:23PM (#43865541)
If I'm reading correctly, they used $1000 running a Llama model, not DistilBERT.
Re:When ChatGPT Broke an Entire Field: An Oral History by teruakohatu on Friday May 02, 2025 @01:57AM (#43866601)
You read it correctly. I obviously didn't explain myself well.