News for hackers. Stuff that matters.
Re:My AI skeptic friends are all nuts by mountainriver on Monday June 02, 2025 @07:18PM (#44164377)
Almost every single major benchmark, and yes progress is incremental but it adds up, this has always been the case
Re:My AI skeptic friends are all nuts by attemptone on Tuesday June 03, 2025 @02:35AM (#44167036)
We were talking about linear improvements and I have yet to see it
Re:My AI skeptic friends are all nuts by mountainriver on Tuesday June 03, 2025 @01:04PM (#44172179)
check the benchmarks or make one of your own
Re:My AI skeptic friends are all nuts by attemptone on Tuesday June 03, 2025 @04:20PM (#44174261)
I checked the BlEU-Score and Perplexity of popular models and both have stagnated around 2021. As a disclaimer this was a cursory check and I didn't dive into the details of how individuals scores were evaluated.
Re:My AI skeptic friends are all nuts by mountainriver on Wednesday June 04, 2025 @12:37PM (#44182596)
on what benchmarks? pretty much every major one is linear improvement