News for hackers. Stuff that matters.
Re:When AI Benchmarks Plateau: A Systematic Study of Benchma... by runarberg on Wednesday August 05, 2026 @10:04AM (#49183083)
Both you and your sibling are approaching LLMs like it is some sort of science. If you do that there is no wonder you have a lot of unanswered questions. LLMs are not a science, they are applied statistics. Making predictions to evaluate hypothesis and constructing theories around the hyperparameters of LLMs is no different then making predictions to evaluate hypothesis and constructing theories around the configurations of Nuclear Power Plants, the latter of course being applied physics.
Re:When AI Benchmarks Plateau: A Systematic Study of Benchma... by pama on Wednesday August 05, 2026 @02:54PM (#49187287)
My point is exactly that we cannot even begin to start the process that will lead to “know everything” there is to know unless we make it a science first. Ad hoc statistical models are different than understanding or complete knowledge of a subject.