When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation

Re:When AI Benchmarks Plateau: A Systematic Study of Benchma... by tsunamifury on Tuesday August 04, 2026 @02:19PM (#49172710)

Yes, it turns out that matrix math over a feature space of math works pretty well because unlike poetry or real world work, maths are internally coherent and entirely theoretical.

[ Parent | on HN ]

Re:When AI Benchmarks Plateau: A Systematic Study of Benchma... by thesmtsolver2 on Tuesday August 04, 2026 @04:48PM (#49174903)

This not understanding "understanding".

> maths are internally coherent and entirely theoretical

Nope. This kind of wish-washy thinking is not what we mean by understanding.

https://iep.utm.edu/math-inc/

[ Parent | on HN ]

Re:When AI Benchmarks Plateau: A Systematic Study of Benchma... by tsunamifury on Tuesday August 04, 2026 @08:53PM (#49177291)

stop with reductionist absurdum.

[ Parent | on HN ]

Re:When AI Benchmarks Plateau: A Systematic Study of Benchma... by gpt5 on Tuesday August 04, 2026 @05:44PM (#49175631)

Funny how you said "it turns out" when the whole point is that we don't understand LLMs - we just empirically see what they are good at.

Claiming that you understand LLMs is similar to saying that you understand how our biology work because you understand evolution. No - you understand the mechanism behind evolution, but not the complexity it produces.

[ Parent | on HN ]

Re:When AI Benchmarks Plateau: A Systematic Study of Benchma... by tsunamifury on Tuesday August 04, 2026 @08:52PM (#49177289)

stop it. This is such reductionist bullshit. By your infinite reductionism definition no one knows how anything works

[ Parent | on HN ]