The question is whether we want mathematics to be dominated by whoever has the most capital. This is perilous because mathematics doesn't produce profits like commerce does. The AI labs might end up killing something off that they are unable to sustain a replacement for.
The goal is to expand and extend our understanding.
When an LLM produces a proof, nobody (including the LLM) gained new understanding ... Unless, of course, a human being sits down and understands it, and communicates the new understanding to the broader community.
If they want to simply generate theorems and proofs and post them on the internet, why not? Does doing that really inflict "substantial negative externalities ... on the mathematical community"?
(They definitely should spend SOME time working with human mathematicians before putting out a press release, but that's exactly what they've done every time)
My point was about what is and isn't the responsibility of AI labs. Why should they be required to invest more (or fewer) resources into math than they otherwise want to?
(If you ask me, safety and security are what they need to invest more into.)
"Academics are paid paltry salaries, university departments are cash-strapped, why are they studying these abstruse math problems instead of building rockets?"
Successfully advancing fields of math and science is a good thing. Why would they not do it. Why would they not want to prove their increasingly intelligent computers are able to solve unsolved, complex math problems humans have failed to solve for centuries and then release the solutions to the public. What do you want them to do, not try to solve them?
In a world, where expensive AI models running thousands of agents produce the most remarkable results, how should the discipline of mathematics look like, when money and access to compute plays such a pivotal role?
With the Navier-Stokes solutions being out in the wild, any mathematician at an impoverished university can make a stab at it and help our understanding. Assume the solutions being held back by those who produced them at Harvard & Co. (until they have their nice articles ready), what would the role of mathematicians be at less affluent universities?
I do not assume AI companies will be ready to provide equal access to their AIs to worldwide mathematics.
1. Academic mathematics has traditionally been meritocratic, and this is a good thing. If you work hard and demonstrate results, then you will be given further opportunities to do math research and the resources to do it. We are concerned that AI will reward money and access to frontier models instead.
2. There is a general concern that AI could lead to massive accumulations of wealth (see concerns of massive job displacement). AI companies claim that they want to raise standards of living and benefit humanity, which means that they will need to share their resources and wealth in some way. If they effectively destroy the mathematical community be racing ahead and taking all the major results for themselves, that does not bode well for the rest of us. It seems like a great opportunity to show the world how AI will benefit humanity rather than replace it.
"The use of proprietary internal models by AI labs to do mathematical research risks creating a two-tier system where labs outrun the rest of the field, effectively alienating the mathematical community from its own discipline."
Are mathematicians' private brains unfair if they're way better at solving open math problems than anyone else? Are they required to share everything they're working on, as they're working on it?
Should Andrew Wiles have been condemned? Wouldn't these arguments all have applied to him? Besides him working at more human speeds.