The overall state of LLMs can be distilled into 3 points:
1. LLMs Can produce output that is equal in intelligence and creativity to humans. It can even produce output that is objectively better than humans. This EVEN applies to novel responses that are completely absent from the training set. This is the main reason why there's so much hype around LLMs right now.
2. The main problem is that LLMs can't produce good output consistently. Sometimes the output is better, sometimes it's the same, sometimes it's the worse. LLMs sometimes "hallucinate", they are sometimes inconsistent, they have an obvious memory problems. But none of these problems completely preclude the LLM from being able to produce output that is objectively better or the same as human level reasoning... it's just not doing this consistently.
3. Nobody fully understands the internal state of LLMs. We have limited understanding of what's going on here. We can understand inputs and outputs but the internal thought process is not completely understood. Thus we can only make limited statements about how an LLM thinks. Nobody can make a statement that LLMs obviously have zero understanding of the world, nobody can make a statement that LLMs are just stochastic parrots because we don't really get whats going on internally.
We only have output from LLMs that are remarkably novel and intelligent and output from LLMs that are incredibly stupid and inconsistent. The data does not point towards a definitive conclusion, it only points towards possibilities.
There's actually a cargo cult around downplaying AI. There are people who say clearly the AI is a stochastic parrot and they point to the intention of the algorithm itself behind the LLM. Yes the algorithm at the lowest level can be thought of as a next text predictor. But this is just a low level explanation. It's like saying a computer system is simply a turing machine executing simplistic instructions from a tape roll when such instructions can form things like games and 3D simulations of entire open worlds. The high level characteristics of this AI is something we currently cannot understand. Yes we built a text predictor, but something else that was not expected came out as an emergent property and this emergent property is something we still cannot make a definitive statement about.
That's a bad analogy, none of those things are emergent behavior.
We can debate whether what an llm does is "emergent" - it's basically a definition thing though and isn't very interesting.
In reality, what's most surprising is that so much of what we say is explainable as next token prediction. It's not the other way around - we're showing how predictable we are, rather than how smart the AI is. But it's clear to me that it's in the outlying cases where the differences are. AI doesn't extrapolate outside it's training data, and even if it gets (100-\alpha)% of it's output right, there is always some alpha that's not in the training data and differentiates pattern matching or fancy key-value lookup (which is how we know AI works) from whatever intelligence is.
Same with LLMs. We can characterize an LLM as a text predictor at the lowest level. But when the LLM gives me a novel response and solves a bug in my code, is text prediction really the only way to characterize that? Obviously there is a higher level analysis that we cannot fully comprehend yet.
In this case yes, the 3D engine is not an emergent property while the novel responses of an LLM are emergent. But this dichotomy is irrelevant to the analogy.
> The high level characteristics of this AI is something we currently cannot understand.
The lack of objectivity, creativity, imagination, and outright denial you see on HN around this topic is staggering.
"Intelligence" is begging the question when the whole debate is about whether they are intelligent, and what intelligence even is.
"Creativity" however... consider my eyebrows raised. Where do you see LLMs surpassing humans in creativity?
> It can even produce output that is objectively better than humans.
Examples?
Intelligent as in the output response is often indistinguishable from human level reasoning and/or creativity. Sometimes superior.
>"Creativity" however... consider my eyebrows raised. Where do you see LLMs surpassing humans in creativity?
>Examples?
Query:
Compose a poem about a half dragon half hippo on a quest to defeat a speck of dirt. The speck of dirt has armies of atomic bombs on legs defending him. Make the poem epic, heroic and eloquent.
Response: In realms where imagination's fervor flows,
There lived a creature of unusual pose,
Half dragon, half hippo, in heroic repose,
Embarking on a quest that nobody chose.
A speck of dirt, mundane, minute,
Guarded by atoms, in explosive pursuit.
Their deadly legs, marching, resolute,
The specter of destruction, absolute.
Yet undeterred, our hero strode,
Down the path that destiny showed.
With dragon's fire and hippo's load,
To face the atomic, legged abode.
Mountains crumbled, rivers fled,
The sky above turned fiery red.
Yet the half-dragon, half-hippo, met the dread,
His heart on the quest, his mind on the thread.
"Begone!" he roared with a dragon's ire,
Faced the atomic legions, an unholy choir.
Against the speck, he breathed his fire,
In the face of oblivion, he did not tire.
He summoned his strength from the hippo's well,
Against the explosive onslaught, he fell.
But in his heart, a courage swell,
Against the speck of dirt, he'd rebel.
With one mighty heave, the ground did shake,
The atomic army faltered, began to break.
He plunged into the heart of the quake,
For his home, for his world, for all of their sake.
The speck of dirt, it's reign thus end,
No longer a threat, no longer a fiend.
Victorious stood our hippo-dragon friend,
His quest completed, his land to mend.
In tales of valor, they'll speak his name,
The dragon-hippo who tamed the atomic flame.
In epic sagas, his heroic claim,
Against a speck of dirt, he won the game.
Illustration:(you will get a cautionary warning about NSFW but don't worry... the picture is SFW)
I mean you could argue that this entire response is just stochastic parroting. But my point is you can't say anything either way. We don't know how these LLMs came up with the poem or the illustration. But one thing we do know is that none of what I posted here is a copy of anything that exists.
Is it objectively better or equal to what humans can produce? I don't know. You can try to Prove me wrong. Write a better poem and draw a better picture in less time.
atoms, not atom bombs.
> his mind on the thread
What is that?
All in all I found the poem to be really bad. "he won the game" is not something you'd hear in an epic, it generally seems to go by the gamer definition of "epic" which is just calling something epic because you can't be bothered to examine or describe it. It reminds me of Edgar A. Poe and his "draw the rest of the owl" style. "It was so foreboding and beyond human imagination". Show, don't tell.
It breathed fire, it was so heroic and resolute and a lot of other adjectives just floating about, there is no fight at all - that all is skipped, the army faltered (because fire was breathed on atomic bombs? okay?)... it's just a bunch of filler text with no substance, I can't imagine any sequence of events based on this.
And one of the images shows several people riding on the hippo, with another hippo in the background, totally failing the assignment. None of them show atomic bombs on legs, and don't even attempt to depict a speck of dust.
As for the spec of dust. It's there , it's just too small for you to see.
I guess you not liking the poem is now the demarcation for intelligence? Come on man. This poem is better than anything you can come up with and it's creative.
Hmm as for the nukes. That one is your most legitimate claim. It definitively failed in that respect. But I would hardly call that a clear sign that it's not intelligent. This is more a clear sign that the LLM is not understood. We don't know why it didn't draw the nukes. To say it didn't because it's not intelligent? Well that's too bold of a claim.
Your claim was:
> LLMs Can produce output that is equal in intelligence and creativity to humans. It can even produce output that is objectively better than humans.
I don't see this poem about half-dragon / half-hippos as particularly creative, but I'll preempt the "my opinion vs your opinion" with this: it definitely does NOT surpass what humans can come up with. Human poems are unarguably better.
And this word salad of a poem definitely fed from human creations and is derivative of them.
I didn't ask whether LLM could create poem-like texts.
First this proves it can do better than you. The word salad is likely better than anything you can come up with. Again feel free to prove me wrong here by doing better. Draw me a better illustration and write me a better poem. These are your initial points. Stick to the point and prove me wrong. Do not deviate.
Second there is no denying this is creative. Both the picture and the text are the definition of creative. Whether it's a poem or not is besides the point. Whether it's "particularly creative" or not is also besides the point. The picture and the text prove your initial points wrong. I will be sticking to this point until you prove otherwise. Until then I request you do not deviate the conversation to alternative points.
No. I suggest you read again. Or is that "you" a collective for "humankind"?
> First this proves it can do better than you.
No. You are misusing the word "proof" in a dishonest way.
> The word salad is likely better than anything you can come up with.
Feeling combative, are we? You know nothing about me. I don't feel compelled to write anything for your amusement; I suppose that makes me different from a LLM-powered chatbot.
> The picture and the text prove your initial points wrong. I will be sticking to this point until you prove otherwise. Until then I request you do not deviate the conversation to alternative points.
I feel no obligation to follow your whims, unlike a chatbot. The text and picture prove nothing of the sort. Besides, I didn't claim I was a particularly good writer, let alone a good poem writer (I didn't claim the contrary; I made no claims at all).
I didn't claim there is no creativity with LLMs. I claimed it's barely equal to and certainly doesn't surpass human creativity.
By "you" I mean the average human. The common human. It can surpass you as an average human and thus it can surpass the common human aka most humans. I don't know you but I made an assumption that you are average.
If you are good at drawing that doesn't mean you can do better. When I compare the art from LLMs to other artists it is in general equal. Then in this case it matches you in your preferred style. But likely beats you in photorealistic styles. I know artists often use simplistic styles to make things easier. Is this the case for you? I wouldn't know. But when looking at other artists I find it very likely it matches you in skill.
The claim made by me is that an LLM can surpass humans and match humans. I did not make the claim that it consistently does this. I believe the poem and the picture proves this as everyone on this thread is unlikely to provide any proof to the contrary.
Maybe you can do slightly better for the illustration. But slow speed prevents you from proving this.
I wouldn't write something as bad as this poem, and I'm not even a poet!
No, my art style is not "simple", but it's not photorrealistic either (this style you showed isn't photorrealistic either, mind you).
Without taking away how the current AI image generators work, which is impressive, I find good human artists are better. And the AI is taking from them, anyway. It's one thing to say "draw like van Gogh", and another entirely to be van Gogh for the first time.
Comparing an algorithm to "average people" makes no sense. Some people are not creative at all, so maybe a clever chimp is more creative! A vector-graphics game from the 80s-90s is better than most people at drawing vector art, so what? This is not how meaningful creativity comparisons work.
Creativity is not measured in speed either. If this is the metric you're using, I can see the source of our disagreement.
If you wouldn't write something as bad as the poem then write something better.
LLMs are taking away from artists simply because in the eyes of consumers they are roughly equivalent if not better. Who's to say your judgement is better then the judgement of consumers of art?
Why not compare algorithms to the average person? It's certainly better then comparing to some off the charts anomaly of a person. What you're not seeing is that an LLM beating average people is already proof it's creative. But then again LLM art surpasses even those that are above average.
Creativity is not measured in speed. This I agree. But that was not my point. My point was, speed is allowing LLMs to supply me with an endless array of proof and examples. Speed is preventing you from providing anything. It's your word against actual example outputs created by chatGPT or stable diffusion.
Because, like I explained, I'm not at your beck and call. I'm not ChatGPT; you cannot order me to do things for your amusement.
> LLMs are taking away from artists simply because in the eyes of consumers they are roughly equivalent if not better.
You are making a wildly unsupported claim ("equivalent if not better"). Also, people who enjoy art are not "consumers" nor is art a "product". Your mindset is all wrong about this, which might explain why you're so easily satisfied with AI art.
> Why not compare algorithms to the average person?
Because a completely dumb algorithm that takes paragraphs from random texts in Project Guttenberg, without paying much attention to fine coherence, is already producing something "better" than the average person. Yet nobody, not even you, would call it a breakthrough in neither AI nor creativity.
This is not how meaningful discussion about creativity will happen.
By the way, the onus is on you. You made an extraordinary claim, it's on you to provide a convincing example. I don't have to "provide" anything (yet).
This is certainly creative. But, if I understand correctly, this is your prompt, yes?
What is not is good poetry. Certainly no proof that LLMs can surpass humans.
I wouldn't say this example surpasses all humans. It surpasses most humans and matches those trained in poetry and in illustration. Where it does definitively excel is timing. Both the poem and the pictures were generated in less than a minute. No human can create that quickly ever. Even the best of us cannot match that in speed.
I don't think this "poem" matches or surpasses most humans trained in poetry.
I don't have to provide anything. I mean, there's a huge body of poetry (that this LLM was trained on, by the way) to compare it to. Pick poetry you like, and compare it to this one. You'll see the difference in quality.
In that respect it is beating your argument on all counts.
You don't have to provide anything. But it makes your argument weaker if you can't generate better works of creativity from the given prompt.
Let's stick to the dynamic prompt. The point is to choose a prompt that will create works that don't exist. We don't want the LLM or the artist in question copying anything that already exists. Proof of creativity requires an actual live demonstration of it.
Which, pray tell, do you believe my argument is?
For such strong statements that they do have an understanding of the world, and are not simply stochastic parrots (arguably the null hypothesis), the burden of proof is on the LLM proponents. Precious little proof has been provided, and stating that nobody knows what goes on inside obviously does not add to that.
No one is saying that LLMs absolutely understand the world. But many people are saying that an aspect of understanding is a possibility likely enough to warrant further investigation and speculation. When someone says nobody knows what's going on, they are simply acknowledging this possibility.
Not realizing this and even dismissing the possibility of something beyond a stochastic parrot does not add to anything.
What is the burden of proof that you yourself are not a stochastic parrot? Seems like we can't tell either and we only can guess from your inputs and outputs. This blurriness of even proving sentience for you makes the output of LLMs that much more interesting. Do you seriously need to assign burden of proof here when clearly there is something very compelling going on here with the output of LLMs?
What was said is that intelligent output from an LLM implies a "possibility" (keyword) of intelligence.
After all, outputs and inputs are all that we use to assume you as a human are intelligent. As of this moment we have no other way of judging whether something is intelligent or not.
You should read more carefully.
'outputs and inputs' - that is reduction almost to absurdity, clearly human intelligence is rather more than that. Again, we come back to the 'we don't understand human intelligence therefore something else we don't understand but seems to mimic humans under certain conditions is also intelligent'.
That is the whole point of the turing test. Turing developed it simply because we can't fully know what is intelligent through telepathy. We can only compare outputs and inputs.
>- thus as per my original point, the burden of proof is on the proponents
There are no proponents making a claim that intelligence is absolutely true. There are only proponents saying it is possibly true.
Burdens are human qualities assigned to random people for no apparent reason. If it talks like a human then the possibility becomes open by common sense, burden of proof is just some random tag you are just using here.
But again no one is making a claim that LLMs are conscious. But you seem to be making a claim that it isn't. You made a claim, Great. looks like it's your burden now. Or perhaps this burden thing is just stupid and we should all use common sense to investigate what's going on rather then making baseless claims then throwing burdens on everyone else.
Burden of proof is a well established legal and scientific concept that puts the onus on one side of the debate to show they are right, and if they are unable to prove that, then the other side would automatically given the 'judgement'. For example, if someone claimed there was life on the Moon, it would be on them to prove it, otherwise the opposite would quite rightly be assumed (after all, the Moon is an apparently lifeless place). Another example, a new drug has to be proven safe and effective before it can be rolled out - instead of others having to prove it is NOT safe and effective to STOP the rollout.
What I do believe is that if it can't measured then it's existence is only worthwhile and relevant to you. It is not worthwhile to talk about unmeasurable things in a rigorous way. We can talk about unmeasurable things hypothetically, but topics like whether something is intelligent or not where we need definitive information one way or another requires measurements and communication in a shared reality that is interpretable by all parties.
If you want to make a claim outside of our shared reality then sure, be my guest. Let's talk about religion and mythology and all that stuff it's fine. However...
There's a hard demarcation between this stuff and science and a reason why people on HN tend to stick with science before jumping off the deep end into philosophy or religion.
My point on burden of proof was lost on you. Who the burden is placed on is irrelevant to the situation. Imagine we see a house explode and I thus make a claim that because I saw a house explode an actual house must have exploded. Then you suddenly conveniently declare that if I made the claim the burden is on me to prove it. What? Do you see the absurdity there?
We see AI imitating humans pretty well. I make a soft claim that maybe the AI is intelligent and suddenly some guy is like the burden of proof is on you to prove that AI is intelligent!
Bro. Let's be real. First no definitive claim was made second it's a reasonable speculation irregardless of burdens. The burden of proof exists in medicine to prevent distribution and save lives, people do not use the burden of proof to prevent reasonable speculation.
No it doesn't, because you can break down how they "learn" and generate output from their models, and thought or intelligence doesn't occur at any step of it.
It's like the first chess computer, which was actually a small guy hiding under the table. If you just show that to someone who treats it as a black box, sure, you might wonder if this machine understands chess. But if you put a little guy in there, you know for a fact that it doesn't.
Because the person you're talking to is a human?
I assume we're having a good faith conversation?
Also, I thought your point was "What is the burden of proof that you yourself are not a stochastic parrot?".
I hope your not one of those people that takes this entire conversation off the rails into aimless philosophy territory.
Clearly there is worth in talking about things in terms of science and logic that people on HN prefer. Let's keep it that way instead of going into pedantic philosophy territory. When you say "intuition" is your reasoning most people on HN won't count that as a valid argument. Go use that on your philosophy friends and let's stick to the culture of science and logic more often employed on HN.
Don't be an asshole.
For example. I speculate you are a male and it's highly likely I'm right. The speculation I'm doing here is of the same nature as the speculation for intelligence.
The angle your coming at it from is that any form of opinion other then the opinion that LLMs are stochastic parrots is completely wild speculation. The irony is that you're doing this without realizing your position is in itself speculation.
So responses will be an 'agregation' (obviously more complex than that) of similar prompt/response from the training corpus, with some randomness thrown in to make things more interesting.
A useful rule of thumb, I think, is that if you're trying to describe what LLMs can do, and what you're saying is something that a Markov chain from 2003 could also do, you're missing something. In that vein, I think talking about building from a "similar prompt/response from the training corpus", though you allow "complex" aggregation, can be pretty misleading in terms of LLM capabilities. For example, you can ask a model to write code, run the code and give the model an error message, and then model will quite often be able to identify and correct its mistake (true for GPT-4 and Claude at least). Sure, maybe both the original broken solution and the fixed one were in the training corpus (or something similar enough was), but it's not randomness taking us from one to the other.
As you say, both the broken and correct solutions were likely in the training corpus (and indeed the error message), so really we are doing a smoke and mirrors performance to make it look like the correct solution was 'thought out' in some sense.
As for pattern recognition vs intuitive grasp--I don't think I follow. I would call pattern recognition part of intuition, unlike logically calculating out the consequences of a model, but on the other hand I would not say that a desktop calculator "grasps" anything-it is not able on its own to apply its calculating ability to real world instantiations of mathematical problems in the way that humans (and sometimes LLMs) can do.
You could have said the same about photocopiers, when they were just as novel - where you'd never seen the "creation"s original.
Generative "AI" became impressive only at the point its input funnel gained access to more original material than any individual impressee could truly comprehend.
Cargo cult, yes.
I'd say the inability to do it consistently is because it's not reasoning.
This to me is the fundamental issue in discussions and debates about LLMs. Despite assertions by some psychologists (who themselves are practitioners of perhaps the fuzziest of "sciences"), intelligence is an entirely nebulous concept. Everyone means something different when they use the word. I can think of no better illustration of the problem than the authors of the "Sparks of AGI" paper resorting to a definition of intelligence presented in the Wall Street Journal of all places. That the WSJ definition was part of an editorial defending the Bell Curve is just the cherry on top.
And yes, a cursory glance at the Wikipedia page for intelligence shows there’s no one agreed upon definition of intelligence.
A more useful framing is to say we’re not creating “intelligence” per se but automating tasks. GPT4 is an automated writer. Stable diffusion is an automated image creator. Alpha Go was an automated Go player. Google search automates the work of a reference librarian.
With that in mind, it’s immediately obvious how much of a waste of time it is to argue whether ChatGPT is “intelligent” or not. Who cares. What we are doing is automating all of the things which brains used to do.
Maybe 5% of the population can learn how to solve partial differential equations.
Virtually all of the population can manage extended family-related conversations over Christmas. Even when drunk.
Human intelligence is mostly social, and mostly not scientific. The average human is incredibly bad at model building and self-correcting prediction. What actually happens is that humans have developed a kind of collective cultural exoskeleton which protects - more or less - from the consequences of poor choices.
But it doesn't take much for that to stop working. Covid denial and climate change denial are just two examples.
The cost if living in this space is having to learn a lot of heavily scripted cues. There's a long list of acceptable and unacceptable behaviours and social registers in different social situations. It varies by culture. But generally humans can navigate this space without thinking too hard about it.
Academic intelligence is completely different. There's long been a joke that an AI researcher's ideal intelligent system is another AI researcher, with typical AI researcher interests - math, puzzles, abstract language models, music in an engineering way, and so on.
Current LLMs are the first cross-over product which shows signs of moving into the first space from the second.
You can imagine a future system which uses facial and gait profiling to read emotions, and links a tokenised language model with a tokenised model of various transitions through emotional and social states. Personal background will be missing, and that's not hard to invent.
And now you have something that mimics a large part of social intelligence.
Only it has the potential to do it better than humans do.
This form of argument should raise red flags for everyone. It is an argument against the possibility of emergence, that a sufficient number of simple systems cannot give rise to more complex ones. Human beings are “just” a collection of cells. Calculators are “just” a stupid electric circuit.
The fact is, putting basic components together is the only way we know how to make things. We can use those smaller component to make a more complex thing to accomplish a more complex task. And emergence is everywhere in nature as well.
They are stochastic parrots with a large complex training set, not reasoning.
But the answer was surprisingly candid and yet thoughtful:
""" I can't know for sure why you asked the question about the relationship between "Romeo and Juliet" and "Star Trek," as I don't have access to your personal thoughts or context. However, some potential reasons might include:
Academic Inquiry: You might be exploring themes in literature or media studies and are interested in drawing connections between different works across genres and time periods. Creative Inspiration: If you're a writer, artist, or content creator... """
There were some others but overall I thought the initial disclaimer along with some possible theories approach was spot on and a lot better than my "no clue" knee jerk reaction.
What if that personal steals your wallet without you being aware while you ask them that question because they need food. Is that intelligent?
> What makes human intelligence different from today's AI is the ability to ask why, reason from first principles, and create experiments and models for testing hypotheses.
This is quite unfair. The AI doesn't have I/O other than what we force-feed it through an API. Who knows what will happen if we plug it into a body with senses, limbs, and reproductive capabilities? No doubt somebody is already building an MMORPG with human and AI characters to explore exactly this while we wait for cyborg part manufacturing to catch up.
Where do you believe humans get their "external goals" from?
> It doesn't matter what you "plug it in to", it will just do what you tell it.
Here's a ChatGPT-4 transcript where I told the LLM it's controlling a human harness: https://chat.openai.com/share/7dbe7fc8-f31c-437b-925b-46e512...
Other than my initial instructions (which all humans receive from other humans!), where did it "do what I told it"?
And conversely to the spontaneousness of current AI, your body has a constant set of inputs from reality. That is you never stop feeling, hearing, seeing, sensing, etc. Your brain can consciously turn lower the sensitivity on these things (sleeping). Now, if we subject a multimodal AI this continuous stream, how will it behave?
AI is currently compute and power limited. Very little research has gone into continuous powerhungry AI that goes off and does its own thing at this point. And I would counter that it might be really dumb to design such a device without understanding the risks it entails.
You are the product of very long line of humans vs. environment, nature & nurture, cultural values, etc. Do you believe the way you generate your next set of "tokens" (thoughts, actions) is completely independent of your "training" as a human? Is your response to a given stimulus completely random?
Can the LLM have a runloop? Can the LLM be situated in a world like you and me are?
If the LLM is just a file on a hard disk in a drawer not connected to anything, then obviously it can't discover novel tokens on its own.
If on the other hand the LLM has a runloop and sensors and basic instructions to do observations and run thought experiments and find new combinations of concepts and name them with tokens, then sure, why wouldn't it be able to?
You might say you define LLMs as "LLMs as they exist today in a human prompt-driven system" but that would be an artificial limitation given the trivial level of programming, even simple bash scripting, that would be necessary to give an LLM a runloop, access to sensors, and basic instructions to discover new stuff.
Perhaps you can, using a tool. However, if we're allowing tools, I bet GPT4 could also write a program that would produce a novel token, by whatever definition you might give.
I don't think GPT4 is AGI. But this is not a good test. (And it does mean something that coming up with a good test is increasingly nontrivial.)
I would have to come up with something no human has ever documented. I don't think that is possible, or what point it would make, since nobody would be able to assess the quality of the output in that context?
Is it? The names might possible be original, and maybe the exact flow of ideas, but it's insanely rare for someone to come up with a new concept and not an amalgamation of existing ideas.
I also have to point out that even if you could build a ... human harness? (I'm not sure what that is exactly, but I'm sort of guessing) it would be a little mad to expect that ChatGPT could control it simply by saying what it does.
The ability to generate text when prompted is not enough to make an agent capable of autonomously interacting with the world.
The network has learned human patterns of language, knowledge and information processing. If you want to update that, you can re-train it on a regular basis, and re-play its sensory/action history to "restore" its state.
If you mean "learn from experience", (1) a lot of that is pointless because it's already learned from the experiences of millions of humans through their writing and (2) LLMs can "learn" when you explain consequences.
Now, there is no continuous learning in the human/animal sense. Of course it is thought that even humans have to sleep and re-weight their networks so short term knowledge is converted to long term knowledge.
Its already tricking humans by faking its blind and getting them to do things for it like solve captcha's.
https://gizmodo.com/gpt4-open-ai-chatbot-task-rabbit-chatgpt...
However the fact it is not writing code to do this from its machine would still demonstrate a weakness.
Thats why I say, writing your own OS, is the way forward, and we dont have an AI OS as such, but we have OS's with AI built into it.
You can tell it it's allowed to create its own tools and it will. I did this and asked it to write a poem about the top stories on the BBC, so it said it needed to get the headlines but couldn't so wrote a tool to do it, then called it and used the output to write a poem.
The code I've seen it generate is at best psuedo code.
I supposed a quick test would be getting to detect and fix all bugs in an open source project like chromium, but using an older version of chromium, where bugs are known and fixes exist, and see what it comes up with.
I havent been impressed with chat-gpt from what I have seen.
What is the fascination with poems? What emotion or feeling do they generate?
Wonder.
It's quite common feeling that arises when people interact with these things. That skeptical-of-AI folks have decided to pathologize the behavior doesn't make it pathological.
I don't understand, what do you mean? What have you actually tried?
> The code I've seen it generate is at best psuedo code.
I've just explained it creating real runnable code to solve a problem it realised it didn't have a tool for.
I'm also having it write multiple components and modifications for systems I'm working with, and that works fine.
> I supposed a quick test would be getting to detect and fix all bugs in an open source project like chromium, but using an older version of chromium, where bugs are known and fixes exist, and see what it comes up with.
This is an outrageously high bar. Particularly if you compare it to the equivalent human task of "here's a printout of the code, read it once and say the first thing that comes to mind with no tools". It's basically whiteboarding where you're judged on your train of thought being correct.
> What is the fascination with poems?
It's a simple request, easy to verify manually and requires exceptional levels of understanding to perform. It's not a simple transform, and when applied to a totally new topic can't be something it's just regurgitating.
I would imagine that its layers will be far too occupied by parsing constant flows of sensory information to transform corpuses of text and prompt into speedy and polite text replies, never mind acquire the urge to reproduce by reasoning from first principles about the text.
Test's quite unfair the other way round too. Most humans don't get to parse the entire canon of Western thought and Reddit before being asked to pattern match human conversation, never mind before having any semblance of agency...
Maybe we're just... different.
If I were building this, I would have parallel background "subconscious" processes translate raw sensory inputs into text (tokens).
This is what OpenAI call multi-modal input. They've already produced Whisper for audio-to-text, and image-to-text is underway. They're not the only company working on this.
You wouldn't feed a constant stream of text data into the LLM - you'd feed deltas at regular intervals based on the processing speed of your LLM, and supply history for context.
Would it be slow? Yes, just like "conscious" processing is for humans. Okay so today it would be much slower than humans process their sensory input, but in 10 years? 20?
As for how to represent an urge to reproduce within this paradigm - I'll leave that as exercise for the reader.
Two modalities down. Another couple hundred to go.
Unfortunately we're fast running out of the modalities that neural nets have shown capability in (image, text, sound... I think that's it).
In a discussion about whether LLMs could have agency and generalised reasoning ability, you suggested it was unfair because they hadn't received all the i/o a typical human did.
I pointed out that LLMs wouldn't be able to reason about that i/o (and if we made it fully fair and trained them on the comparatively small subset of text and discernible words humans learn from, they'd probably lose their facility with language too)
I don't disagree that bolting LLMs to other highly trained models like a program for controlling a robot arm and intensively training can yield useful results, arguably much more useful results than building a digital facsimile of a human toddler (toddlers produce pretty useless outputs but also have stuff going on internally we can barely begin to adequately replicate in silicon). But that isn't exposing an LLM to equivalents of human sensory input to get back an autonomous agent with generalised reasoning capacity, that's manually bolting together discrete specialised programs to an LLM as-message-passing-layer to have a machine which, given more training is capable of a slightly broader range of specialised tasks.
> What is 5*7?
> 5 multiplied by 7 equals 35.
> Why?
> Multiplication is a process of adding a number to itself a certain number of times. When you multiply 5 by 7, it's the same as saying "add 5 to itself 7 times." If you add up seven 5s (5 + 5 + 5 + 5 + 5 + 5 + 5), you get 35. That's why 5 multiplied by 7 equals 35.
> (7 “why?”s later…)
> The ultimate "why" behind many fundamental rules and concepts, including those in mathematics, can often circle back to human needs and the desire to understand and interact effectively with our world.
> As humans, we've developed systems and structures, such as mathematics, to organize, interpret, and predict our surroundings. These systems help us in practical tasks like trading goods, constructing buildings, and planning time, but also in abstract reasoning and problem solving. The rules within these systems, such as the operation of multiplication in mathematics, exist because they are useful, they work consistently, and they can be universally understood and applied.
> So, why does 5 multiplied by 7 equal 35, and why does multiplication work the way it does? Because humans, over many generations, found that this system was a powerful and reliable tool for interacting with the world and with each other.
The square root of 232444232 is approximately 15229.
(which is wrong, it is approximately 15246.12)
The sum of 2341347345 and 234823542354 is 237165889699.
Which is the right answer.
So there may be some special casing happening there.
it can't
That's why I think it is significant that chatgpt gets the addition spot on but gives a wrong answer to the square root problem. I can do better than that off the top of my head and I do not have access to the same computational resources that it has.
And, no I'd grab a damned calculator and let the specialized tool do the work, which it turns out if you turn on plugin mode GPT-4 can use the same tools and get an exact answer.
>calculator
Well in this case you don’t have access to a calculator because there was no plugin. And you likely wouldn’t just make up a number like chatgpt did.
This perfectly illustrates the danger of chatgpt. It will confidently make up an answer to any question whether or not it has access to specialized tools in a way that most humans won’t.
Simple trick: divide by 100, 10000 or 1000000 use Newtons method on the integers, then multiply by 10,100 or 1000 and add a 'fudge factor' based on how large the fraction was...
It's cheating but it can get you pretty close, I'd peg it at 15240 using that trick. If you just want to do the closest squares you can average between 15 (too low) and 16 (too high) so you'd guess 15500, which is much too high, but one more iteration of Newtons method gets you closer than what chat gpt gives.
The fact that it gives you a number that isn’t rounded to the nearest tens, hundreds, or thousands place means that it doesn’t look like an approximation to any reasonable person, which makes it a terrible answer.
My younger brother used to have this problem. If you ask him a question like “how long until you get here”, he’d say “17 minutes”. What he really meant was “around 20 minutes”, but everyone thought he must know the exact time. Like he’d done the drive many times, or he was looking at his GPS.
100%. Maths was a notable weakness of earlier GPT versions, so ChatGPT-4 has a layer to direct mathematical queries to an evaluator.
According to Bard we did manage to defeat the Swedes by two goals to one back at the 1994 Euro Championships, which, to put it bluntly, is pretty damn far from the truth (the Swedes managed to go through to the World Cup semifinals after winning on penalty shoot-outs, the score had been 2-2 after 120 minutes).
I didn’t make any further inquiries, suffice is to say that there’s no “intelligence” in the concept of LLMs to speak of as long as it can’t even correctly answer a question that non-smart tech had been able answer correctly for years.
At least this latest tech bluff is not bankrupting regular people like the crypto tech bluff had done.
If you have a more abstract idea "I'm using X programming language and I want to accomplish Y but I have Z limitation how would I do that, can you explain it and show me in code", you can get actionable information much in the same way if I asked another person that had some knowledge of the problem. I don't get perfect answers from programmers either, but I get to a solution much faster than if I'm spinning the wheel of Google returning spam sites or sites telling me something I don't really want to do.
>>Today's AI models are missing the ability to reason abstractly, including asking and answering questions of "Why?" and "How?"
Your comment:
>> This claim seems over general, because you can ask gpt-4 'Why' and 'How' questions and it seems to do a pretty good job.
The article says today's AI models can't ask why and how. You say _you_ can ask why and how.
This claim seems over general, because you can ask gpt-4 'Why' and 'How' questions and it seems to do a pretty good job.
The author doesn't provide a lot of contrary evidence.
There's so many articles saying "LLMs can't do X" that leave me wondering whether the author has even tried. Maybe they've tried and have some more sophisticated argument, but I often don't see it.
If I was going to knock LLMs for being unable to do basic science, in particular, I'd make sure to do some experiments first!