Re:My AI skeptic friends are all nuts
by mountainriver on Monday June 02, 2025 @07:18PM
(#44164377)
Almost every single major benchmark, and yes progress is incremental but it adds up, this has always been the case
[ Parent
| on HN ]
Re:My AI skeptic friends are all nuts
by attemptone on Tuesday June 03, 2025 @02:35AM
(#44167036)
We were talking about linear improvements and I have yet to see it
Re:My AI skeptic friends are all nuts
by mountainriver on Tuesday June 03, 2025 @01:04PM
(#44172179)
check the benchmarks or make one of your own
Re:My AI skeptic friends are all nuts
by attemptone on Tuesday June 03, 2025 @04:20PM
(#44174261)
I checked the BlEU-Score and Perplexity of popular models and both have stagnated around 2021. As a disclaimer this was a cursory check and I didn't dive into the details of how individuals scores were evaluated.
Re:My AI skeptic friends are all nuts
by mountainriver on Wednesday June 04, 2025 @12:37PM
(#44182596)
on what benchmarks? pretty much every major one is linear improvement