The value of a proof? People have assumed it's true for so long that there are any number of results already proved "if the Riemann hypothesis is true".
What value does the proof add?
Remember, not too long ago we had hordes of folks here proclaiming machines can't think, reason or be creative in any productive sense. Many still do, but it's starting to look bleaker by the day.
The tool isn’t doing the thinking or the proof on its own.
Machines can absolutely think. It's really all they do.
> reason
Murky, but LLMs prove with an avalanche of statistical modeling, they can do something kind of analogous to reasoning, with the caveat that whatever they output will necessarily have to exist in some fashion in their training data.
> or be creative
Absolutely not. By definition an LLM cannot create original work, it can only remix and recombine what it already knows. That can be interesting, and bloody useful especially for code tasks, but it is not making anything original.
What (if anything) unambiguously counts as original work, according to this definition?
I leave what is truly original to the philosophers. What I can say for certain, is that anything you get out of any of these models is a remix of what is present in it's training data, because gravity exists and energy is conserved. They are not intelligent, they are not conscious, and they cannot make New things.
But doesn't that same argument apply to humans, where 'training data' = all our sensory inputs (plus what's encoded in our DNA, depending on whether we want to analogise that to the training data or the underlying architecture)?
> Arguing the definition of original is pointless for the exact reason you point out: that it's ambiguous.
I'm not trying to be a smartarse here but you are the one who is claiming absolute certainty that something is false 'by definition', so I think the onus really is on you to have a precise definition in mind.
> They are not intelligent, they are not conscious, and they cannot make New things.
I'm not a consciousness denier or anything, in fact I think it is the most important thing in the world, but I don't understand the connections you're making here. 'Intelligent', like 'original', can be defined and needs to be defined for this statement to be meaningful. 'Conscious' is probably inherently slippery, but if we mean the same thing by it (having subjective experience/qualia) then I have no idea how you could be certain that any other entity lacks it. And it seems like you may be implying that consciousness is a necessary condition for originality, but I don't think you've explained how.
Pretty crazy interview, he didn't want throw the Anthropic employee under the bus when OpenAI offered co-authorship on the Navier Stokes paper. He suspects OpenAI somehow used his codex usage btw. Almost unprovable of course.
"I said that if OpenAI released its result in the way proposed I would go public with what happened. The reply was, 'Why would you ruin your career?' I replied that I am an academic, and asked why he thought going public would ruin my career. The reply was, 'If you don't want me to be nice, then I don't have to be nice.'" (Sébastien Bubeck later apologized on X for the remark.) "Sebastien twice asserted that he wanted Levent removed from authorship..." "The second was that, after posting Euler, I alone write a paper presenting the Navier-Stokes result, acknowledging that an internal OpenAI model had resolved it."
"I asked whether the model had been trained on, or had access to, our sessions in Codex, into which we had been putting all our drafts for the whole of this project. I was told the model did not look up user data. I asked again, about training, and I did not get an answer." (OpenAI subsequently stated publicly that while unlikely, it could not rule out that de-identified data from their product usage improved the model.)