News for hackers. Stuff that matters.
Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by himata4113 on Tuesday March 24, 2026 @12:32AM (#47498621)
It's less of solving a problem, but trying every single solution until one works. Exhaustive search pretty much.

It's pretty much how all the hard problems are solved by AI from my experience.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by famouswaffles on Tuesday March 24, 2026 @12:47AM (#47498698)
If LLMs really solved hard problems by 'trying every single solution until one works', we'd be sitting here waiting until kingdom come for there to be any significant result at all. Instead this is just one of a few that has cropped up in recent months and likely the foretell of many to come.
Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by raincole on Tuesday March 24, 2026 @12:36AM (#47498641)
In other words, it's solving a problem.
Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by slg on Tuesday March 24, 2026 @12:51AM (#47498717)
Yes, but is it "intelligence" is a valid question. We have known for a long time that computers are a lot faster than humans. Get a dumb person who works fast enough and eventually they'll spit out enough good work to surpass a smart person of average speed.

It remains to be seen whether this is genuinely intelligence or an infinite monkeys at infinite typewriters situation. And I'm not sure why this specific example is worthy enough to sway people in one direction or another.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by parasubvert on Tuesday March 24, 2026 @02:26AM (#47499210)
Someone actually mathed out infinite monkeys at infinite typewriters, and it turns out, it is a great example of how misleading probabilities are when dealing with infinity:

"Even if every proton in the observable universe (which is estimated at roughly 1080) were a monkey with a typewriter, typing from the Big Bang until the end of the universe (when protons might no longer exist), they would still need a far greater amount of time – more than three hundred and sixty thousand orders of magnitude longer – to have even a 1 in 10500 chance of success. To put it another way, for a one in a trillion chance of success, there would need to be 10^360,641 observable universes made of protonic monkeys."

Often infinite things that are probability 1 in theory, are in practice, safe to assume to be 0.

So no. LLMs are not brute force dummies. We are seeing increasingly emergent behavior in frontier models.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by staticassertion on Tuesday March 24, 2026 @02:44AM (#47499316)
> So no. LLMs are not brute force dummies. We are seeing increasingly emergent behavior in frontier models.

Woah! That was a leap. "We are seeing ... emergent behaviors" does not follow from "it's not brute force".

It is unsurprising that an LLM performs better than random! That's the whole point. It does not imply emergence.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by parasubvert on Tuesday March 24, 2026 @01:19PM (#47506091)
> It is unsurprising that an LLM performs better than random! That's the whole point. It does not imply emergence.

By definition, it is emergent behavior when it exhibits the ability to synthesize solutions to problems that it wasn't trained on. I.e. it can handle generalization.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by staticassertion on Tuesday March 24, 2026 @01:23PM (#47506146)
Emergent behavior would imply that some other function was being reduced to token prediction. Behaving "better than random" ie: not just brute forcing would not qualify - token prediction is not brute forcing and we expect it to do better, it's trained to do so.

If you want to demonstrate an emergent behavior you're going to need to show that.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by qsera on Tuesday March 24, 2026 @03:17AM (#47499479)
> We are seeing increasingly emergent behavior in frontier models.

What? Did you see one crying?

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by rmast on Tuesday March 24, 2026 @01:04AM (#47498781)
Maybe infinite monkeys at infinite typewriters hitting the statistically most likely next key based on their training.
Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by virgildotcodes on Tuesday March 24, 2026 @01:06AM (#47498790)
The real question is how to define intelligence in a way that isn't artificially constrained to eliminate all possibilities except our own.
Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by qsera on Tuesday March 24, 2026 @02:25AM (#47499206)
A random sentence can also generate correct solution to a problem once in a long while...does not mean that it "solved" anything..
Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by kranner on Tuesday March 24, 2026 @12:39AM (#47498651)
Bet you didn't come up with that comment by first discarding a bunch of unsuitable comments.
Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by raincole on Tuesday March 24, 2026 @12:59AM (#47498754)
I hired an artist for an oil painting.

The artist drew 10 pencil sketches and said "hmm I think this one works the best" and finished the painting based on it.

I said he didn't one shot it and therefore he has no ability to paint, and refused to pay him.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by virgildotcodes on Tuesday March 24, 2026 @12:43AM (#47498680)
You learned what was unsuitable over your entire life until now by making countless mistakes in human interaction.

A basic AI chat response also doesn't first discard all other possible responses.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by bfivyvysj on Tuesday March 24, 2026 @12:41AM (#47498667)
How often do you self edit before submitting?
Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by ivalm on Tuesday March 24, 2026 @12:46AM (#47498692)
because commenting is easy and solving hard problems is hard
Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by konart on Tuesday March 24, 2026 @02:11AM (#47499135)
But this is exactly how we do math.

We start writing all those formulas etc and if at some point we realise we went th wrong way we start from the begignning (or some point we are sure about).

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by jasonfarnon on Tuesday March 24, 2026 @01:19AM (#47498859)
The link has an entire section on "The infeasibility of finding it by brute force."
Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by kelseyfrog on Tuesday March 24, 2026 @12:47AM (#47498697)
How do you think mathematicians solve problems?
Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by adventured on Tuesday March 24, 2026 @12:35AM (#47498633)
No, that's precisely solving a problem.

Shotgunning it is an entirely valid approach to solving something. If AI proves to be particularly great at that approach, given the improvement runway that still remains, that's fantastic.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by lsc4719 on Tuesday March 24, 2026 @12:34AM (#47498628)
That's also the only way how humans solve hard problems.
Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by himata4113 on Tuesday March 24, 2026 @12:38AM (#47498646)
Not always, humans are a lot better at poofing a solution into existence without even trying or testing. It's why we have the scientific method: we come up with a process and verify it, but more often than not we already know that it will work.

Compared to AI, it thinks of every possible scientific method and tries them all. Not saying that humans never do this as well, but it's mostly reserved for when we just throw mud at a wall and see what sticks.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by coderenegade on Tuesday March 24, 2026 @02:34AM (#47499257)
That's just not true at all. There are entire fields that rest pretty heavily on brute force search. Entire theses in biomedical and materials science have been written to the effect of "I ran these tests on this compound, and these are the results", without necessarily any underlying theory more than a hope that it'll yield something useful.

As for advances where there is a hypothesis, it rests on the shoulders of those who've come before. You know from observations that putting carbon in iron makes it stronger, and then someone else comes along with a theory of atoms and molecules. You might apply that to figuring out why steel is stronger than iron, and your student takes that and invents a new superalloy with improvements to your model. Remixing is a fundamental part of innovation, because it often teaches you something new. We aren't just alchemying things out of nothing.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by himata4113 on Tuesday March 24, 2026 @03:37PM (#47507914)
Well, we know that mixing lead into copper won't make for a strong material. There's a lot of human ingenuity involved.

I failed to make my point clear: Humans make the search area way smaller compared to current day AI.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by virgildotcodes on Tuesday March 24, 2026 @12:42AM (#47498674)
More often than not, far, far, far more often than not, we do not already know that it will work. For all human endeavors, from the beginning of time.

If we get to any sort of confidence it will work it is based on building a history of it, or things related to "it" working consistently over time, out of innumerable other efforts where other "it"s did not work.

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by nextaccountic on Tuesday March 24, 2026 @01:13AM (#47498832)
AI can one shot problems too, if they have the necessary tools in their training data, or have the right thing in context, or have access to tools to search relevant data. Not all AI solutions are iterative, trial and error.

Also

> humans are a lot better at (...)

That's maybe true in 2026, but it's hard to make statements about "AI" in a field that is advancing so quickly. For most of 2025 for example, AI doing math like this wouldn't even be possible

Re:Epoch confirms GPT5.4 Pro solved a frontier math open pro... by jMyles on Tuesday March 24, 2026 @12:36AM (#47498639)
There have been both inductive and deductive solutions to open math problems by humans in the past decade, including to fairly high-profile problems.