> "Of course we don’t know whether that is true"
Yep. Who is verifying these claims? We all know how trustworthy Altman & Co are.
Separate from all the allegations of more nefarious actions and ethical issues, that’s the most charitable version of what happened here.
And according to them at some point they saw that one was close to being solved, so they pointed all the agents at it.
The same thing happens to humans - at this time there are no simple problems left, so solving the hard ones requires using prior knowledge and attempts at solving things.
If I write a book and pass it through a spelling and polish checker, I still wrote the book and its core IP. I didn’t “rely on” the tool to create the IP.
The OpenAI effort was a pure brute force attempt. I'm not even sure an LLM was actually involved. I think they just used their hardware to run the matrix multiplies required by the search for a counter example. Perhaps some clever approach guided the search but that seems to be about it.
Professor says the assistants - why don't you dig in this direction, I have a hunch it might produce something valuable. And AI assistant does just that, proving or disproving a hunch. This would take the professor a lot of time if doing by themselves.
A better example would be playing chess against a player slightly stronger than me and using a chess computer to suggest some good moves. I could win, but it certianly wouldn't be just my brain that wins. It would be an amalgamation of my brain with a machine that suggests good moves.
One cannot simply reason by analogy.
My iPhone keyboard does
This likely doesn't happen exactly on an analog keyboard, but then many text-processing environments that do the same thing in post. My keyboard just edited 'yuor' to 'your' even though I successfully input the prior string.
Work on something novel -> llm is kinda useless and low value-add -> Keep at it and in the process feed it more information -> keep doing this periodically -> a few months go by and you realise the model outputs are almost like-for-like regurgitations of what was inputted in some prior period.
Once it’s accumulated new info can it produce something automated that is somewhat useful? Sure.
But by itself - absolutely not.
I clearly see humans will be needed - the best ones that is. For ‘rote work’ and stuff that is not IP sensitive firms will be ok with employees putting that as inputs into models.
But I’d wary about trusting the labs. They will push the letter of the law to the max.
Personally I’ve stopped doing anything novel with these models. If I do use a model on something adjacent but not totally novel I have to craft the inputs in a strategic way not to give much away.
I’d wager firms will soon realise this and that growth rate of revenues of the frontier labs will become questionable. The economic cost that firms have brought out thus far is only financial. There’s a whole bunch of other costs people aren’t talking about.
I guess I'm having trouble unraveling your experience and personal usage vs. what you're concluding about the labs.
To avert that dynamic, the frontier labs must deflect and otherwise act to prevent this controversy from breaking through. Both to the general public, but also more specifically to the firms' decision-makers. All of whom are generally aware of the IP issues, and some of whom are aware of what happened with Cursor and Figma, but with few exceptions have not yet themselves acted to protect their property.
This proof is just checking the boxes for mathematicians.
OpenAI (claim to) show the existence of *a* finite time singularity. It could stimulate more research in PDE solving, and maybe physics, but it has zero impact on practical applications, that I can see. The Millenium problems were chosen based on hardness not practical relevance.
> This proof is just checking the boxes for mathematicians
There are already quite a lot of summaries of the story that lead to the solution, and the impact that the intermediate results have had.
> For any practical application, numerical solvers for Navier-Stokes already exist and do a good job.
or
> This proof is just checking the boxes for mathematicians.
Do you think it is possible that better math will lead to better physics models?
Not all.
Ehrhart’s volume conjecture
Quantum parallel repetition for general two-player quantum games
Erdős Problem #183 on multicolor Ramsey numbers
Erdős–Sárközy Problem #12(i)/(ii)
Erdős Problem #125
Log-concavity of codimension-3, type-2 pure O-sequences
Optimal O(1/t) last-iterate convergence for Anchored Gradient Descent-Ascent
Prior updated :)
So yes, the models do seem to be "solving" the problems themselves, but not necessarily in the way we think of mathematical discoveries happening. Academic mathematics has historically been resource constrained: There are a limited number of top-level mathematicians, and they only have so much time and brain power to spend. So when approaching a problem, they are essentially forced to be as efficient as possible, not just searching for a solution, but for one that can be achieved within their cognitive budget. This induces them to develop novel techniques and abstractions, and it is actually those techniques and abstractions that tend to be the valuable part for further research, not the proof itself.
An agentic swarm is like getting a single skilled mathematician, cloning them a hundred times, then locking them in a room with the single objective of solving a problem. No longer constrained by time or brain power, they can approach it differently, using pre-existing techniques to gradually build their way to a solution. This process might not require a single intuitive leap or new discovery, and the solution will not be simple or elegant, but they will probably get there. It is more like a process of intelligently guided search than invention.
Also, OpenAI wanted the actual mathematician taken off the resulting paper. I'm not sure I would describe what OpenAI did as research. What the other team was doing does seem to be more like research but the hardware was still in those cases mostly brute forcing things and then doing something like a genetic algorithm to compose an actual proof based upon the results of a large set of brute force attempts.
It certainly seems like any problem that is amenable to reinforcement learning will be solved.
you're not actually spending that money. it's sunk cost, as you already bought the hardware. at least for the big pharmaceutical companies for drug development. then you run your own local model, trained on special data, with special etc, etc... to the end of buying GPUs for what, 3.5-6.5M/rack or so (GB300 NVL72, Google AI summary pricing quote) becomes a bargain (vs the double digit billions you need to spend on a new drug R&D).
Solve for how to implement and synthesize physically? Not likely.
Humans solved for launching rockets to the Moon on paper decades before it happened.
Pareto type thing; the logical work is the easy 80%. The last 20% is fighting physics.
There is no beating physics but there is still plenty of room for us to improve our understanding of it.
Which we weren't focused on at all sitting millions primates at well understood physical computers searching for Shakespeare Python and Ruby code yet merely getting same old contemporary software outputs.
It’s akin to ‘understanding’ something at the surface vs going very, very deep into the details.
It would be like saying proving ergodicity more generally for physical systems would unlock condensed matter physics, ignoring how well stat mech has served us regardless.
I am not anti-AI and I don't think we should stop throwing them at conjectures. I'm against this fundamentally misleading type framing that's become prominent. Millennium prize problems are important. Treating this specific aspect of NS as the one missing piece is just harmful. If we just throw compute at formal conjectures voila cancer and fusion.
I think the better example of "AI" usefulness toward solving problems is AlphaFold, and immensely powerful tool. But also suffering from a false framing/marketing problem as "solving protein folding". It feels like the right use of compute. Considering many factors that we can't hold in our head at once. "Solving" something that was already "solved" via computation (simulation) but now much more efficiently. The output is a valuable tool itself, it was not about "solving the protein folding problem", which it didn't do. It is a tool to solve problems requiring a sequence->ground state calculation. Which is a very broad set.
Formal verification of a conjecture we set up as a benchmark we set to test human understanding is not valuable in the same way.
I'm failing to make multiple points and gotta run, but i think that final point is important. The millennium prizes are not about technological/practical value, at least not intentionally. They're about shit that seems fundamental to us, things that feel[1] to us based on our understanding are important AND feel like they should be solvable in a human-comprehensible way. So formally resolving them with pure compute is not really the point. It seems closer to that story about one of those prime conjectures where some guy just ran brute force enumerations to find a counterexample. Valuable for sure, time-saving. And knowing the answer makes it a lot easier to solve a problem.
TL:DR science and math are more than formally resolving conjectures, they're about building up understanding and tooling that you can then build more on. AI should be an increasingly big part of it, but declaring "AI will solve fusion because it's smart" is like the rest of the fucking owl meme. I have no doubt it will help, most likely via simulations/quicker testing/calculations and verification. Maybe partly via reactor designs. Maybe partly being fed conjectures about bounds/limits that would be useful as inputs for the next iteration. And maybe even in the form of resolving some formally stated conjectures (I don't know enough plasma physics to name any).
[1] obviously to the mathematicians it's more than a feeling..
Those problems can’t be formally verified with an automated theorem prover. We have a lot of physics based simulation tools, but they tend to focus on small subsets of the full design problem and they make limiting approximations because otherwise they’d be too computationally expensive, or we just don’t have the right data to parameterize them beyond describing qualitative behavior. Agents are helping accelerate research in these fields but I think it’s mostly a different class of problem that’s a lot harder to specify and verify