"Very refined prediction engine" is not a bad working definition for intelligence. It is not the only component you need, but it might be the most important over-all capability.
If its making lots of errors, its not doing a very good job of predicting the outcome of its actions.
Your other point that humans need very few examples for learning vs. what LLMs need is an interesting one. A few researchers talked about this very thing on the most recent episode of Dwarkesh's podcast.
My own view is that it seems unfair to compare an LLM's training with just what a human gets over the course of a lifetime, because our brains have been trained by a billion years of evolution for pattern matching. I'm not at all confident that AI models won't catch up.
This is one of the most distinctive qualities of human intelligence compared to many animals - is our ability to adapt to new situations and make accurate predictions of the outcomes of our actions. Other animals can also do this but over very narrow time horizons and situations.
AI agents are better at it than any animal, and better at it than humans in some domains.
Silly and pointless criticism. Why do the semantics of the word intelligence matter?
Also, you need to understand that language evolves over time, and people often use a word to describe a thing that is newly discovered or invented that's similar to the word being used, because it's a helpful way of describing it that the listener will understand better than a longwinded technical description. The purpose of language is to communicate thoughts, not engage in pedantry.
> But things like this slip by a frontier model in the same way AI from a few years ago would generate an image with seven fingers.
Yes, you make an excellent point here that over time, the capabilities of these models to recognize certain categories of problems have increased dramatically. I expect this will continue!
> it's foolish to give them "a company" to run, because they cannot understand when they've made a mistake the way even the least competent human can.
The words of someone who has not spent time with the least competent human, or anything close to it.
It matters because, we're still sorting out what intelligence means for an AI agent. As you pointed out, language evolves over time. The question remains whether or not attributing intelligence to the current iteration of models is correct. This is not settled and I don't see why it's wrong to bring it up.
One thing is clear: LLMs at least already are capable of 1) not making the same mistake that person made, and 2) clearly seeing why the other person's post was "wrong" in both reasoning and tone.
Being good in chess was (and still is) associated with being intelligent. But if a computer does it, it is just a calculator (and it is).
Then go, the great game for intelligence, too complex for calculators to have a chance against intelligent humans. Until it was solved.
And then text, the original Turing test solved, AI capable enough to fool humans. And now already replacing humans in jobs strongly associated with intelligence - programming.
I find it hard to debate, that we don't have created artificial intelligence, by the way we used to use the word "intelligence" before.
So if AI is really understanding something?
Likely not in the way we use that term. But it definitely shows intelligent behavior and actions.
Hey, look I can make unsupported claims with just as much evidence as you!
Maybe you'd like to add some details as to why AlphaGo and its successors haven't "solved" Go (insofar as a game like Go can ever be "solved")?
Other people know there is no solving go with calculating, but using statistics to achieve the goal of becoming better at humans. And they are. (With a recent unexpected exception unlikely to be repeated more often)
But this was the original statement - so solved references "chance against intelligent humans". And this is clearly solved. No comment on that there cannot be better go engines, but no matter how painful it is, they beat the best humans. (And it was painful, they did cry)
Or I guess to put it another way, if we want to coin a new term for the intelligence-esque thing that AI has, but the key differentiator is that it's an AI thing and not a human thing, then what linguistic value does the new word have? If I said "Claude is intelligent" then the fact that we're talking about AI "intelligence" is already captured in the sentence anyway; no new word needed
We're all well aware that we have different thresholds for what we consider intelligence, and that these thresholds are constantly changing.
Even if we agree that "LLMs are AI!!!" or "LLMs are not AI!!!" in this thread, all we've established is that this particular set of commentors share a similar enough definition at this point in time.
We can argue about words like thinking and intelligence all day long, and so can an LLM. But at the end of the day the LLM is only mimicking the processes you or I use.
Last week I tried out gpt sol 5.6 and asked it to count the letter r in a massive string of letters, without using an external app. It succeeded until I made the garbage sentence suitably large and then it consistently, confidently failed. Each time the "thinking" showed that it was teething to find a "gotcha" each time. "Ah, the first time I forgot to count the letters in the instruction itself" etc. at no point did it just understand that it had miscounted. It seems to be incapable of considering that it just made a regular mistake. Even a six year old child would just try again the same way and end up with the right answer
You give AI an input, and then an output is created...a very coherent and deep output in fect...but, there is very little understanding of alternatives or downstream implications in my experience.
I think its a very good text/image generator on any subject. But I am not finding much in the way of understanding tradeoffs or downstream implications in a non-pro's and con's list. It's like a human that has a particular type of brain damage...they can make an infinite pro/con list, but not reasonable decision is reliably made.
They have no intelligence. These are very very very refined prediction engines.
> A common set is having Claude take some product photos and turn them into lifestyle ones using ChatGPT via Claude in Chrome. It's a pretty well-honed workflow at this point, but it'll still return images where the product is obviously not correct and seemingly not notice them.
Obvious to you or I, or someone with actual intelligence. But things like this slip by a frontier model in the same way AI from a few years ago would generate an image with seven fingers. They do not count. They do not understand. They do not consider.
No matter how good these models appear to be at intelligent tasks, it's foolish to give them "a company" to run, because they cannot understand when they've made a mistake the way even the least competent human can.