News for hackers. Stuff that matters.
Re:My AI skeptic friends are all nuts by mountainriver on Tuesday June 03, 2025 @01:04PM (#44172179)
check the benchmarks or make one of your own
Re:My AI skeptic friends are all nuts by attemptone on Tuesday June 03, 2025 @04:20PM (#44174261)
I checked the BlEU-Score and Perplexity of popular models and both have stagnated around 2021. As a disclaimer this was a cursory check and I didn't dive into the details of how individuals scores were evaluated.
Re:My AI skeptic friends are all nuts by mountainriver on Wednesday June 04, 2025 @12:37PM (#44182596)
on what benchmarks? pretty much every major one is linear improvement