News for hackers. Stuff that matters.
Re:An OpenAI model has disproved a central conjecture in dis... by paulddraper on Wednesday May 20, 2026 @04:25PM (#48213618)
"LLMs just interpolate their training data"

Cracks me up.

What exactly do we think that human brains do?

Re:An OpenAI model has disproved a central conjecture in dis... by charlie90 on Wednesday May 20, 2026 @06:05PM (#48214871)
I agree. Humans are given a body that lets them "discover" things on accident, test out ideas, i.e. randomness.

As in, I would hazard a guess the discovery of the wheel wasn't "pure intelligence", it was humans accidentally viewing a rock roll down a hill and getting an idea.

If we give AI a "body", it will become as creative as humans are.

Re:An OpenAI model has disproved a central conjecture in dis... by omnimus on Wednesday May 20, 2026 @04:40PM (#48213808)
That has been the question since the beginning of humans.

Maybe computers can help understand better because by now it's pretty clear brains aren't just LLMs.

Re:An OpenAI model has disproved a central conjecture in dis... by baq on Wednesday May 20, 2026 @04:52PM (#48213966)
The optimists believe brains are very special and we’re far from replicating what they do in silicon.

The pessimists just see a 20W meat computer.

Re:An OpenAI model has disproved a central conjecture in dis... by omnimus on Thursday May 21, 2026 @10:32AM (#48223319)
And almost everybody seems to forget the brains are about to be replaced every 10 years for past 50 years.
Re:An OpenAI model has disproved a central conjecture in dis... by __s on Wednesday May 20, 2026 @06:22PM (#48215044)
Creativity is hard. Pretty much needs a fuzzer process to generate new strings, mostly nonsense, & pick up when that nonsense happens to be correct
Re:An OpenAI model has disproved a central conjecture in dis... by oh_my_goodness on Wednesday May 20, 2026 @06:52PM (#48215408)
We don't know what human brains do.
Re:An OpenAI model has disproved a central conjecture in dis... by fragmede on Wednesday May 20, 2026 @07:48PM (#48215941)
We have some idea.
Re:An OpenAI model has disproved a central conjecture in dis... by ActorNightly on Wednesday May 20, 2026 @05:22PM (#48214328)
I love this comment because it so clearly highlights the difference between intelligence and reasoning.

A lot of people across all fields seem to operate in a mode of information lookup as intelligence. They have the memory of solving particular problems, and when faced with a new problem, they basically do a "nearest search" in their brain to find the most similar problem, and apply the same principles to it.

While that works for a large number of tasks this intelligence is not the same as reasoning.

Reasoning is the ability to discover new information that you haven't seen before (i.e growing a new branch on the knowledge tree instead of interpolating).

Think of it like filling a space on the floor of arbitrary shape with smaller arbitrary shapes, trying to fill as much space as possible.

With interpolation, your smaller shapes are medium size, each with a non rectangular shape. You may have a large library of them, but in the end, there are just certain floor spaces that you won't be able to fill fully.

Reasoning on the flip side is having access to very fine shape, and knowing the procedure of how to stack shapes depending on what shapes are next to it and whether you are on a boundary of the floor space or not. Using these rules, you can fill pretty much any floor space fully.

Re:An OpenAI model has disproved a central conjecture in dis... by gpugreg on Wednesday May 20, 2026 @04:44PM (#48213852)
Maybe the human brain also does other things besides interpolation?
Re:An OpenAI model has disproved a central conjecture in dis... by paulddraper on Wednesday May 20, 2026 @05:20PM (#48214300)
There is pre-training, and then empirical observations.

Yes?

Re:An OpenAI model has disproved a central conjecture in dis... by slashdave on Wednesday May 20, 2026 @08:24PM (#48216205)
You have to define what you mean by "interpolate". The mechanisms that LLM use are not mysterious, and they are not the same as used by humans.
Re:An OpenAI model has disproved a central conjecture in dis... by drdeca on Wednesday May 20, 2026 @09:11PM (#48216537)
If you interpret “interpolate” in the literal sense, and apply it to the mechanisms behind LLMs, then the claim that they only interpolate, is straightforwardly false.

Taking it instead as a metaphorical claim may be more valid, but in that case it doesn’t depend on our understanding of how LLMs work.

Re:An OpenAI model has disproved a central conjecture in dis... by slashdave on Wednesday May 20, 2026 @10:53PM (#48217263)
LLMs are statistical models by construction, so depending on how liberal you want to be with terminology, "interpolate" is not so bad. Might make a statistician upset.
Re:An OpenAI model has disproved a central conjecture in dis... by baq on Thursday May 21, 2026 @01:42AM (#48218349)
They’re also capable of performing arbitrary computation when ran in a loop - so they can be made to quite literally interpolate whatever. Philosophers are quite upset, too.
Re:An OpenAI model has disproved a central conjecture in dis... by slashdave on Sunday May 24, 2026 @01:59AM (#48254816)
Define "arbitrary". Without RAG, they screw up basic algebra.
Re:An OpenAI model has disproved a central conjecture in dis... by drdeca on Thursday May 21, 2026 @02:07AM (#48218540)
But people aren’t giving a (less literal) definition of what they mean by “interpolate” that relies on the internal mechanisms of these models, just a vague metaphor, which, as this vague metaphor, there’s nothing it uses about LLMs that makes the question “do LLMs just interpolate” less of a type error than “do people just interpolate”.

And I don’t think it’s a good metaphor.