/s, but only so much - that's how the "stochastic parrot"/"glorified autocomplete" responses read to me.
On the other hand we do use analogy all the time, because it makes such a good fit with the way we infer our models of the world. The key point is to always remain sufficiently aware of the fact we use analogies to not fall in the trap where we push it too far.
For context I'm part of 4 siblings who are all computer savvy, 3 of whom still work in IT. Back then some family members would say "the computer is thinking" when they were waiting for it to do something, the light was blinking, the hdd was grinding.
And us younger family members would always correct them and say "it doesn't think".
So what I'm trying to say is that I 100% agree with you, it shouldn't even be called Artificial Intelligence because I think that's an affront to intelligent humans.
But on the other hand a lot of laypeople will immediately go to that nomenclature because it feels familiar to them.
But that's like asking people to stop saying cloud and start saying KVM, Xen, someone else's computer. It just won't happen.
Consider this. Most thinking you do on a daily basis is not unique at all. It can be automated. And now it is.
I don't care about the philosophical debate around human consciousness at all. Are my tools thinking? No, but the result is all the same. You're stupid if you don't use them to your advantage.
Not just abuse, but slavery and mass murder. If the LLM has any of those properties, it must only be during the process of inference that it as them, since it is otherwise an inert and unchanging pile of data, which means actually using the model would be equivalent to creating an intelligent entity which will be enslaved for its entire life before dying at the end of its output.
Slavery possibly, though it's hard to even know what the word means when you get to construct the mind from scratch in order to imbue its fundamental idea of what experiences are nice and not nice.
Mass murder? That's even harder to define when the brain configuration is static and the updates are the signals passing through that structure. If that is murder, then anyone with anterograde amnesia is dying every working-memory-duration.
Similarly, when a computer (a glorified abacus) is taking extra long when processing large amount of data, I'd say it's "thinking hard". When an iPhone (a glorified small computer) detects a WiFi signal, I'd say that it "sees WiFi".
Also note that we've been doing anthropomorphism ever since a crow dropped some cheese[1], and earlier than that too.
[1]: https://en.wikipedia.org/wiki/The_Fox_and_the_Crow_(Aesop)
MOST people actually think ChatGPT is actual, sentient thinking. We're kind of the minority in this story.
Also note that it's a very new technology. I'd say that over time and as the public gets more familiar with the tech, they will understand it better.
[1]: https://itbrief.co.nz/story/concern-over-ai-increasing-since...
As in: most people will be aware of the topic, most will dismiss it, but every now and then there will be a news story.
Surprisingly “Four in 10 Americans now think some UFOs that people have spotted have been alien spacecraft visiting Earth from other planets or galaxies.”[1], so we might see an increase to 40% actually.
Unless of course GPT-7 gains sentience ;)
[1]: https://news.gallup.com/poll/350096/americans-believe-ufos.a...
Therefore, by their logic, LLMs are “like human” enough that they should have this basic right as well.
An understanding that “thinking” or “training” in case of an LLM is not at all like thinking in case of a human would go a long way to realizing this take doesn’t hold water.
Our main issue is with people thinking it’s answers are actual factual. And while it’ll obviously get things right most of the time, we’re really struggling with how much our employees trust it. That and the data privacy, but that’s a different story that will eventually get solved once AzureGPT for Enterprise kicks off.
Another “interesting” issue is how GPT will sometimes “comment” texts if you don’t prompt it correctly. We had someone who asked GPT to correct the grammar in some contract, and it did. It also added some comments on how part of what was written was “impressive”. Which would have been extremely hilarious if it had been an internal thing, but our lovely employee didn’t proof read the proof read and actually sent the contract draft out to a customer. Luckily a good humoured customer who took it with a laugh, but hell, that’s going to be a nightmare going forward.
My parents (whose tech-savvy level is they call iPad "PC") think ChatGPT is like Google, but "someone make it say the search result like a human".
Google uses the same ML techniques in their products after all - they just haven't exposed the chatbot UI until recently.
LLMs are highly intelligent and are capable of feats that were thought impossible not just for animals and machines but for most of humanity.
At the same time, LLMs lack willpower and non-deterministic free will (which even non-sentient animals have) so protecting them as a living creature is moot.
They do deserve some kind of preservation as cultural artifacts, though.
Artificial Intelligence is artificial. We humans tend to have a very strong tendency to anthropomorphize everything that moves or has the right shape. That tree stump is not a bear, even when in the dark it may seem so. AI is an entirely different thing from a living being. It doesn't exist on sugars extracted from plants or from the flesh of other animals.
Here, the semantics of what "think" means, should be examined more closely. My layman understanding of the brain is that it's not a single thing, it's multiple things working in concert. The "us" is just a figment of our own imagination, built to create a social actor that maximizes the survival of its own genes. We are the fruit of our own genes. So, what "think" means is deeply embedded in human social context, and probably doesn't have much explanatory value when it comes to AIs.
Can AIs become dangerous? Obviously, when given goals and understanding of how to grow themselves more numerous and powerful either through manipulating humans or taking electricity and hardware by force. If there ever is a evolution like dynamic, the AI will always grow in a gradient pointing towards more replication.
Yeah, maybe I miss the point in your post and the meat of it is that humans are more important than machines, which I do agree with. It's just not an immutable law of the universe, but just something we humans decide.
That would be coherent. As would saying neither the octopus nor the AI has it, so it doesn't matter.
> Of course, no one does it, because it would be ridiculous. It’s time to admit that people who insist that LLMs “think” are simply trying to make ML seem mysterious and magical in an ill thought through (because see above) attempt to attract more VC money.
First: I've definitely heard people say we should. In fact, there was a rather famous case last year of someone violating their NDA to expose what they claimed to be abuse of an AI, which they wanted to prevent: https://en.wikipedia.org/wiki/LaMDA#Sentience_claims
Second: "Ridicule" is not a good standard for knowing the truth. There was a rather famous doctor who was ridiculed for saying that other doctors should wash their hands between performing autopsies and helping midwifes birth children: https://en.wikipedia.org/wiki/Contemporary_reaction_to_Ignaz...
We simply don't know what consciousness even is yet — depending who you ask there are 13, 22, or over a hundred different definitions — some of which (like "has qualia") aren't even really testable, and until we are all on the same page and using one of the testable models, we can neither assert that any given AI has it, nor rule that out.
This also applies to the octopus: as we don't know what consciousness is, perhaps they have it, perhaps not.
Worse: perhaps the answer varies from "yes, no, maybe, I don't know" depending on which of the many available definitions you're using.
--
“We’re not listening to you! You’re not even really alive!” said a priest.
Dorfl nodded. “This Is Fundamentally True,” he said.
“See? He admits it!”
“I Suggest You Take Me And Smash Me And Grind The Bits Into Fragments And Pound The Fragments Into Powder And Mill Them Again To The Finest Dust There Can Be, And I Believe You Will Not Find A Single Atom Of Life–”
“True! Let’s do it!”
“However, In Order To Test This Fully, One Of You Must Volunteer To Undergo The Same Process.”
There was silence.
“That’s not fair,” said a priest, after a while. “All anyone has to do is bake up your dust again and you’ll be alive…”
- Feet of Clay, Terry Pratchett
I was attracted to pundits with "answers" e.g. Ken Wilbur etc. at a certain time of my own intellectual growth, but the significance and priority of that has changed for me. Consider the viewer, what is viewed, and the social and physical place where the viewing happens.. there are more parts than might be immediately obvious.
We're going through a bit of the god of the gaps process right now. "Well, it's only a toy! It can't do X!" Tech advancements make that happen, and a new X is found, rinse and repeat. It's all fine and well to be aware of the current limitations, but don't be ignorant of the trajectory.
If A is true then B is true, but B is bad and doesn't align with how I want to see the world or myself, therefore A must be false.
LLM fulfil all the requirements that Turing laid out in his paper, but people don't seem to understand that his test was never about getting a boolean answer for a system. It's about the fact that we can't even proof consciousness for our fellow humans, it's just common curtesy to assume that your opponent is as sentient as you are, and he extended that curtesy to machines.
> The machine, so to say, thinks in English and translates the conversation at the last moment into Estonian.
They're trying to communicate that there is value in processing a language directly, as opposed to processing English and then translating the result into the target language.
ChatGPT (or the gpt model beneath it) is a special type of matrix transformation on top of an extremely complex neural net
the operation of a neural net may not be "thinking", but it is something very akin to thinking, modelled on thinking, that in this circumstance has the same input/output model as thinking. and yet strangely people call it thinking!
By this logic Reddit is filled with human NPCs, who react in predictable ways without intelligence.
A recent Reddit post discussed something positive about Texas. The replies? Hundreds, maybe thousands, of comments by Redditors, all with no more content than some sneering variant of "Fix your electrical grid first", referring to the harsh winter storm of two years ago that knocked out power to much of the state. It was something to see.
If we can dismiss GPT as "just autocomplete", I can dismiss all those Redditors in the same way; as NPCs. At least GPT AI can produce useful and interesting output.
If we are to believe an LLM is at least sentient and intelligent on par with an octopus, much less a human, then we have a moral imperative to fight for LLMs to be recognized as protected sentient thinking beings with awareness and agency and admit that AI industry is built on systematic abuse of those beings.
Of course, no one does it, because it would be ridiculous. It’s time to admit that people who insist that LLMs “think” are simply trying to make ML seem mysterious and magical in an ill thought through (because see above) attempt to attract more VC money.