News for hackers. Stuff that matters.
Re:Sharing AI progress in mathematics by bamboozled on Wednesday October 07, 2026 @01:27AM (#49988614)
Why would the trick have any "origins", isn't this model creating new techniques never before seen or imagined?
Re:Sharing AI progress in mathematics by hasley on Wednesday October 07, 2026 @01:53AM (#49988816)
There is a chance that someone from a completely different field came up with a solution for a tiny part of your problem.

If you can remember the content of any scientific publication and any book in the world, you are able to make use of this knowledge in every step of you proof.

However, this does now answer how the model came up with the specific route it has taken for the proof.

Re:Sharing AI progress in mathematics by WarmWash on Wednesday October 07, 2026 @02:59AM (#49989299)
LLMs don't have super memory like that. I mean I don't know what this internal OAI model is, but at least for other LLMs, they aren't databases of training data with a smart search on top.
Re:Sharing AI progress in mathematics by hasley on Wednesday October 07, 2026 @03:14AM (#49989392)
I did not mean to say that an LLM knows literally all the publications. But the abstract knowledge is probably encoded in the weights.
Re:Sharing AI progress in mathematics by matusp on Wednesday October 07, 2026 @05:03AM (#49990116)
The agents here very likely used search. On top of that, they have boundless patience and can quickly process top K hits to find what they need. This is exactly the skill that is super useful for finding various niche sub-proofs that can help you build the final proof. A human mathematician is not going to digest 1000 papers from a different sub-field to find the needle they want, not knowing if it is actually there. AI can do it in few hours.
Re:Sharing AI progress in mathematics by AIblemblio on Wednesday October 07, 2026 @05:09AM (#49990162)
No but they have training data which teaches them certain amount of complex understandings and just not math but also physics. So this is one huge advantage.

And then they are for sure able to fill their context based on 'smart search on top' to actually progress further.

Re:Sharing AI progress in mathematics by _zoltan_ on Wednesday October 07, 2026 @05:58AM (#49990521)
As Terry Tao said, LLMs are not outsmarting us, they are out remembering us.

I'm fairly sure your understanding is not fully accurate.

Re:Sharing AI progress in mathematics by shinywth23 on Wednesday October 07, 2026 @07:01AM (#49991021)
I'm not convinced anyone really understands the difference.
Re:Sharing AI progress in mathematics by komali2 on Wednesday October 07, 2026 @01:41AM (#49988722)
As I understand it it's undetermined yet whether LLMs can actually come up with anything novel or are instead pulling from their incredibly deep corpus of knowledge to present solutions that were there but we didn't realize it because our brains aren't libraries of almost all human writing.
Re:Sharing AI progress in mathematics by TeMPOraL on Wednesday October 07, 2026 @02:46AM (#49989202)
Only in the same sense it's not yet determined about humans, either.
Re:Sharing AI progress in mathematics by RandomLensman on Wednesday October 07, 2026 @03:55AM (#49989653)
Not so sure. Was everything already "there" before humans existed?
Re:Sharing AI progress in mathematics by TeMPOraL on Wednesday October 07, 2026 @05:32AM (#49990331)
In some form and shape, yes. Humanity's creativity is a lot of marginal copying and remixing.

But obviously, it adds up to something greater than went in; in aggregate, our contributions are something to awe.

But my point is, if you zoom in at the marginal, incremental contributions of any individual human in this process, it's really hard for me to say LLMs are not at the same level already.

On this topic, people like to compare LLMs to Einstein, but as far as I know, Einstein did not zero-shot special relativity in an afternoon. He built it up incrementally over time, it took him three times longer than the time between first ChatGPT release and today, and it depended on centuries of prior art, culminating in the right observation and right notation being available to him in his moment of greatness.

Re:Sharing AI progress in mathematics by RandomLensman on Wednesday October 07, 2026 @06:10AM (#49990631)
Unless everything was there before humans existed humans created some ideas etc from scratch and not just remixed and copied.

At what level LLMs are is then an entirely separate discussion, I think.

Re:Sharing AI progress in mathematics by TeMPOraL on Wednesday October 07, 2026 @06:46AM (#49990918)
> humans created some ideas etc from scratch and not just remixed and copied.

Name three.

Re:Sharing AI progress in mathematics by RandomLensman on Wednesday October 07, 2026 @06:58AM (#49990999)
What would you accept as evidence there? Are, for example, the first names/words for colors from scratch?

So your view is that everything was there at the creation of the universe (it's a possible view, of course)? Or are there any "things" that can create ideas from scratch?

Re:Sharing AI progress in mathematics by pka on Wednesday October 07, 2026 @07:59AM (#49991525)
Recently I watched a documentary on the tanzanian Hadza tribe, one of the last hunter gatherer tribes on Earth. Their language is a distinct click and pop language and they regularly imitate animal calls (monkeys, baboons, birds) when they hunt but also when they communicate with each other, tell stories etc.

I think it's not impossible that words evolved as adaptations of the environmental sounds with which our ancestors lived. The human creativity producing DNA is also a remix of preexisting molecules formed under evolutionary pressure, so the view that it's turtles all the way down, unintuitive as it is, may not be so indefensible after all.

Re:Sharing AI progress in mathematics by komali2 on Wednesday October 07, 2026 @09:30AM (#49992596)
But LLMs aren't turtles all the way down, they stop at vector embedded tokenized words.
Re:Sharing AI progress in mathematics by TeMPOraL on Wednesday October 07, 2026 @01:55PM (#49996357)
I mean what is your criterion on invention here? On the one hand, each specific word could be seen as a new invention. On the other hand, all languages basically correlate strongly with the environment of their users - it's why LLMs turn out to be universal translators - and pattern-matching is hardly an invention, isn't it?
Re:Sharing AI progress in mathematics by pka on Thursday October 08, 2026 @05:40AM (#50003748)
I don't know, but my current intuition is that invention = more or less preexisting ingredients + some tiny spark of creativity ("connecting the dots") rather than this grand myth of "creating something from nothing". And then the tiny spark could itself be a remix of previous tiny sparks (connecting the dots between dot connections, a bit like maps between n, n+1, n+2, ...-dimensional manifolds), and so on.

> and pattern-matching is hardly an invention

Exactly. That's what I meant with turtles all the way down, until the tiny spark disappears into a dot and it turns out that creativity is just an illusion - akin to how nobody would call the gene (the spark, the pattern matching) formed by evolution (the brain connectome) "creative".

Re:Sharing AI progress in mathematics by TeMPOraL on Wednesday October 07, 2026 @01:57PM (#49996388)
My view is that LLMs meet the standards by which we judge human creativity/inventiveness, and thus that one cannot claim LLMs "just repeat, never invent" without the same being true about humans.
Re:Sharing AI progress in mathematics by komali2 on Wednesday October 07, 2026 @09:29AM (#49992569)
Pornography, "I Want it That Way" by the Backstreet Boys, torque wrench.
Re:Sharing AI progress in mathematics by throwawayk7h on Wednesday October 07, 2026 @02:04AM (#49988888)
Synthetic data allows them to train well past the limits of human writing.
Re:Sharing AI progress in mathematics by komali2 on Wednesday October 07, 2026 @09:31AM (#49992600)
What's an example of synthetic data?
Re:Sharing AI progress in mathematics by AIblemblio on Wednesday October 07, 2026 @05:11AM (#49990181)
No this is not an issue. As long as their is a way of verifying things, they do the same thing with creating novel things as humans: Searching through an infinite space of possibilities opitmized by knowledge.

They combine things, verify it and if it works and progresses the problem, they created something new.

Re:Sharing AI progress in mathematics by kelseyfrog on Wednesday October 07, 2026 @01:39AM (#49988717)
Let me introduce you to 'obscure Russian mathematicians'.