News for hackers. Stuff that matters.
Re:An OpenAI model has disproved a central conjecture in dis... by voooduuuuu on Wednesday May 20, 2026 @04:07PM (#48213374)
I think you are conflating composition and prediction. LLMs don't compose higher abstractions from the "axioms, symbols and rules", they simply predict the next token, like a really large spinning wheel.
Re:An OpenAI model has disproved a central conjecture in dis... by peterlk on Wednesday May 20, 2026 @04:14PM (#48213465)
Yes they do…? Who cares if they just predict the next token? The outcome is that they can invent new abstractions. You could claim that the invention of this new idea is a combination of an LLM and a harness, but that combination can solve logic puzzles and invent abstractions. If a really large spinning wheel could invent proofs that were previously unsolved, that would be a wildly amazing spinning wheel. I view LLMs similarly. It is just fancy autocomplete, but look what we can do with it!

Said differently, what is prediction but composition projected forward through time/ideas?

Re:An OpenAI model has disproved a central conjecture in dis... by voooduuuuu on Wednesday May 20, 2026 @04:16PM (#48213493)
Ask an LLM to invent a new word and post it here, I will be waiting. You will see that it simply combines words already in the training data.
Re:An OpenAI model has disproved a central conjecture in dis... by romanhn on Wednesday May 20, 2026 @04:32PM (#48213701)
I'm not sure what the point of this exercise is. My prompt to ChatGPT: "Create a new English word with a reasonably sounding definition. That word must not come up in a Google search." Two attempts did come up in a search, the third was "Thaleniq (noun)". Definition: The brief feeling that a conversation has permanently changed your opinion of someone, even if nothing dramatic was said. Nothing in Google. There, a new word, not sure it proves or disproves anything. Or is it time to move the goal posts?
Re:An OpenAI model has disproved a central conjecture in dis... by jimmaswell on Wednesday May 20, 2026 @04:30PM (#48213673)
Why is everyone who responds to this with a real example immediately flagged/dead?
Re:An OpenAI model has disproved a central conjecture in dis... by sillysaurusx on Wednesday May 20, 2026 @04:33PM (#48213714)
HN autokills LLM generated comments. People don’t seem to believe this, but there’s proof for you.
Re:An OpenAI model has disproved a central conjecture in dis... by planetafro on Wednesday May 20, 2026 @04:29PM (#48213662)
Splifket

Definition: That highly specific, short-lived burst of nervous energy that makes you accidentally drop a small object (like a pen, a guitar pick, or a piece of LEGO) immediately after picking it up.

Re:An OpenAI model has disproved a central conjecture in dis... by bossyTeacher on Wednesday May 20, 2026 @04:21PM (#48213551)
Does a random sequence of letters qualify as a new word?
Re:An OpenAI model has disproved a central conjecture in dis... by FrustratedMonky on Wednesday May 20, 2026 @04:34PM (#48213728)
"Who cares if they just predict the next token?"

Exactly. I also only write one word at a time. Who knows what is going on in order to come up with that word.

Re:An OpenAI model has disproved a central conjecture in dis... by sunshowers on Wednesday May 20, 2026 @04:17PM (#48213503)
One might argue that the composition of higher abstractions is the next token predicted after "here is a higher abstraction:"
Re:An OpenAI model has disproved a central conjecture in dis... by adampunk on Wednesday May 20, 2026 @04:09PM (#48213411)
How sure are you that this is correct?
Re:An OpenAI model has disproved a central conjecture in dis... by frozenseven on Wednesday May 20, 2026 @04:26PM (#48213636)
Show me on the anatomical prop where the magical "real reasoning" gland is.
Re:An OpenAI model has disproved a central conjecture in dis... by bigstrat2003 on Wednesday May 20, 2026 @11:24PM (#48217494)
Nice smug attitude, but LLMs fall flat on their face over and over and over again at tasks no human would fail. They can't even reason out things that literal children succeed at. It's ludicrous to claim that they have some kind of reasoning ability.
Re:An OpenAI model has disproved a central conjecture in dis... by outpost_mystic2 on Wednesday May 20, 2026 @11:49PM (#48217649)
> It's ludicrous to claim that they have some kind of reasoning ability.

Did you read the post that you're commenting on?

It seems wholly believable to me that they are narrow intelligences that are great at some kinds of reasoning and worse at other kinds. Obviously they can reason through problems that most adult humans can't solve

Re:An OpenAI model has disproved a central conjecture in dis... by umanwizard on Wednesday May 20, 2026 @06:22PM (#48215042)
"Predicting the next token" is meaningless. Every process that has any sort of behavior, including a human writing, can be modeled by some function from past behavior to probability distribution of next action. Viewed this way, literally everything is just "predicting" the next action to be taken according to that probability distribution.

The most likely series of next tokens when a competent mathematician has written half of a correct proof is the correct next half of the proof. I've never seen anyone who claims "LLMs just predict the next token" give any definition of what that means that would include LLMs, but exclude the mathematician.