I don't understand this skepticism towards tool use. It's like saying, "I'm sad that Reimann Hypothesis solution was published as a PDF and not in a parchment or made as a verbal announcement."
Anyway, great accomplishment. What an incredible thing to wake up to.
But at the same time one of my favorite memories from childhood as an introvert nerd math / computer guy is locking myself in a room for an evening and relying on my brain to solve and truly understand a problem. I'm nostalgic for that. A solution that requires 250k pages to describe takes something away from that.
Humans are complicated and contradictory, which is great!
Doesn't make progress sad?
Previously our talented contribution was doing the thinking. Now, AI seems to do this as a separate entity.
Pretty sure he didn't just prompt 'Solve Riemann, make no mistakes'
Or used a forklift to build a house that everyone else said couldn't be built because it was beyond human muscle.
It's naturally going to be upsetting to everyone if reality unfolds to show that human intelligence is nothing special, and actually not even that good.
We have the same thing with LLMs. We don't know how they work. We don't understand them. We have only empirical, statistical indications, nothing is proven. We know how the small parts behave, we really understand those, and also the different algorithms. But they whys? No. We're getting better, but still far away.
As far as not knowing how it works, that becomes a bit of a philosophical problem. We know how LLMs work and their algorithms. I think we can always play up "we don't know" is disingenuous ways. How many people who made Apollo calculations could also write long proofs and theorems of the fundamental maths they were using from first principles? Not a lot. We're always standing on someone's shoulder. We'll never truly know everything or how exactly our tools work on an individual level. Maybe AI changes things because an innovation may not have a direct line to a Isaac Newton at its base, but I think that's a bit of a vague and poetic difference, and not a real one. Its still human achievement but via machinery.
I can't even begin to make sense of that lack of basic understanding of humanity.
Also, people are nervous that the mechanization of new human capabilities will give even more power to money and less to labor, and we will live in some distopian libertarian society. I think that is a separate and realistic fear from the grief of discovering our thoughts are not as special as we told ourselves.
For me, if I am confident that the social structure will enable fulfilling lives for people, my kids and their peers, then I am ok with exploring and understanding the possibilities of mechanized cognition.
And to those objecting to the phrase mechanized cognition, I use Claude a lot and the thing I find missing is that independence of perspective that all the people I encounter have. We wake up with a perspective and goals and preferences, a why to answer what built into the protoplasm. Some technology will rebuild that aspect of our experience in a different substrate, but it doesn’t feel like a system that can’t count but can prove Riemann is quite wired correctly for that fleshy self motivated loop.
One felt a camaraderie with all mathematicians in history because mathematics was, wonderfully, a club with no bouncer, the only cover charge being a bit of concentration of attention. Not that one could join the elite ranks of Gauss, Euler, et al. by association, but the bonhomie was real for a lot of us, realizing that all of the legendary mathematics was dreamt up in the same way that we were engaging in it, too.
That horse has left the barn, decidedly, and there is grief.
There's a reason Paul Graham wrote Hackers and Painters and not Hackers and Assembly Line Workers.
Many people long to be craftsmen and to have an understanding of their place in the world and within the social hierarchy.
These folks want to perfect some art or craft, to be the best, or to be skillful, to "create" and find joy in creation, and they pursue a level of purity in the art. Totally human, completely normal, and part of what has led to our success and advancement as a species. Think about your open-source maintainer, or the gal who has Ruby on Rails stickers plastered on their laptop, or maybe you yourself as you try to get excited about the super boring details about the latest release of some open-source package you want to be the expert in (why?). They want to be "hackers" and "painters"!
The problem is that the pursuit of this particular craft (software development) falls into the realm of Science and Industry. Engineering, code, electronics, machines, experiments - all of these things and more are part of those two fields and those two fields by definition require and improve upon existing technology or understanding and as such they are fields which change often, cause some skills to become obsolete without remorse, and they do so at a fast pace.
The software engineer who believes in their craft and their expertise in JavaScript is finding that Science and Industry no longer value that craft and expertise - so that person's place in the world is directly under threat, including their income in many cases. It causes a range of emotional reactions.
You can see how this manifests with many software engineers going on to do silly things like move to Japan and live on a mountain top to write code in peace, or start a Substack newsletter that nobody ever reads, or build expensive tiny sheds ("houses") so they can go in to their back yard and "code in piece" - i.e. pursue their craft. Another common theme is minimalism - flat surfaces, clean lines, things like that. The person seeks more and more control. If only they could just remove this inefficient piece of furniture at last they can finally code and do my painting in peace with my perfect coffee and get in to my zen flow. It's a whole psychology, and it's under grave threat from AI.
With the threat of AI, of course the natural human instinct for many of these very intelligent software engineers (most are about average intelligence however) is to perhaps physically and culturally retreat and go "farm" (interesting how they try to go pursue other crafts isn't it?) or emotionally retreat "AI isn't a big deal, I'm important, this technology won't beat out my craft" and these very natural human reactions you are seeing are due to psychological defenses built up by average people who believe their livelihoods are under threat.
So the comments will of course be around things like denial, or impurity (it's not pure enough that the Saturn V was built - that's cheating, we should have invented wings and flew there ourselves), or it'll manifest into a mechanism in which many are actively cheering on a foreign adversary to "beat" their home country because it'll validate them in some weird way. See? Look what you did. You created AI and now we're behind! Told ya! There's no changing their mind because their job depends on their mind not being changed.
It's difficult for someone like yourself to combat these feelings that you don't understand without first understanding them, and to understand them is to brush away some of the nonsense that people get up to and get back to basics which is that many people feel under threat from advancements in technology, many people want but lack a sense of place in social hierarchy and purpose in life ,and for those that do have such things these advancements threaten to disrupt their current lives and purpose. Of course they're going to tell you we should walk to the moon instead of building the Saturn V (AI).
Their lives depend on it!
I think it's quite telling that by "landing on the Moon" you meant the humans landing on the moon and not the first actual landing on the Moon by human-made machines.
So it looks like you do think that it's less of an accomplishment after all.
It might have a lot of engineering credit (setting up the swarm, ...)
> I'm just too inexpert in the relevant stuff at the moment, I hope the reader sees the breadth of this argument!
> I intend to do my best to understand and impart understanding of this argument
He was shepherding Claude.
I am not saying he could have done this without Claude. But there's a reason he did it and not anyone else. This wasn't a case of giving Claude the prompt "solve riemann hypothesis make no mistakes"
This is the part that deniers love to ignore.
I have a substantial math background and certainly can't yet prompt LLMs to solve extraordinarily hard proofs. This is a real achievement. That the logic wasn't 100% worked out by a human is less exciting than what this enables.
I am still a bit sad though. I had hoped the Rieman hypothesis would fall mostly to a human mathematician rather than 60/40 AI/mathematician that my layman's read of that note interprets.