The thing to remember is that it is more ML /'Machine Learning' than it is an AI / Artificial Intelligence analog to humans.
They're high bandwidth retained graphs that can be executed on as a fuzzy match on anything, graphical, textual, etc. So that's useful! Even powerful ML systems compete on a different strata than individual humans (both George Hotz and Mark Zuckerberg have this last take! Musk and Gates and Altman are a bit more hyped for political reasons...).
People at Apple never say "AI" publicly, they call it "ML"!
It is in fact changing the nature of certain industries right now, and at the same time doesn't impact others so much directly.
I know nothing about AI but it seems like we're approaching it from the other end - the human mind seems like magic and when we approximate it using technology it feels like we'll reach a moment of "that's all it is?" and refuse to believe we actually did it because we doubt ourselves.
Along the same lines, if achieving equal human rights for all humans were a trip to the corner store, the fight for AI rights is going to be like Mount Everest.
I used to think this and worried that AI would never have rights (see, e.g., sibling comment to mine), but these days I tend to think the fight will be very brief and heavily in the favor of AI. It could be the first time in history that rights are achieved so quickly that there isn’t much of a struggle at all.
That said, I find it extremely depressing that the default human viewpoint is “it’s a machine and doesn’t deserve rights”. Hopefully AI will have a superior system of morality to ours as well.
I find this to be quite comforting. It means we haven't completely uprooted all of society overnight and have time to stop and think about what this new technology can do for us and what it means for the future.
And what do you feel when we make these parlor tricks more capable than us at the majority of tasks?
And what do you feel when we understand it well enough to realize we're the same type of parlor tricks?
To me it seems like you're most interested in a magic 'aha' moment and will miss or not be prepared for how the road in front of us likely unfolds.
This seems like the logical fallacy of "begging the question" since it is far from apparent to me that they are "more capable than us at the majority of tasks."
Good voice transcription AI already do that too; that's why they work best if they know which language they're operating in, as that means they can use the language to create a model of the most likely words.
I think the most recent WWDC from Apple even has a video about adding custom vocabulary for their speech engine to pick up on that covered some details in this exact topic, though I can't search right now.
Absolutely, AI is very rarely human in its failure modes, and often has novel and exciting failure modes instead.
But, on average… or so the marketing claims… it makes fewer mistakes.
For a while, it was possible to improve upon super-human chess AI by pairing them with a human; the combination was called a centaur. Eventually the AI got too good even for that as they stopped making the sorts of mistakes humans could spot, but in the meantime, even though they were superhuman, they had failure modes that we could help out with.
If it is or not, depends on the specific use of the transcription.
Consider "I went to Lenny's" being transcribed wrong by a human as "I went to Denny's" or by an AI as "Ivan to Lenny's".
Both are wrong, but if you get a human to check, we can be oblivious to the human mistake for the same reason it was made in the first place plus the effect where seeing text alters our perception of what we hear; the AI error being inhuman means we can spot it when the human error is imperceptible.
The answer is that we have programmed these systems to do what we require. They cannot exceed but they fail becasue of errors that we have placed in these systems.
All of the tasks that you have mentioned have been programmed that way. It has taken human ingenuity to work out how to do this programming. The end result is a machine (non-sentient, non-intelligent) that is doing what we require.
If you look at game playing, a system was created to play Go and won and yet that same system fails to win against humans under many circumstances. The literature is there, yet not publicised for all the world to see. A result of keeping the hype in play.
If you look at speech recognition, these systems still fail when we humans work against them and yet, we humans still recognise what the machines fail at.
Just keep in mind that a tractor can move a greater amount of material than a human can, but it is still only a tool. A plane can travel faster and fly higher that a human can, but it is still only a tool.
We use these systems to augment our abilities and yet they are all limited in so many ways that we are not.
The upshot is that we can do amazing things with the things we create, but none of those things exist without us and all those things fail without us.
The successful Go AI were programmed to learn; we still can't program a decent Go AI with rules humans come up with.
> The literature is there
Do you have a link? Two Minute Papers just had a video about an AI systematic finding ways to confound other AI, but I thought we'd passed the point where the best Go AI could be so manipulated by humans…
I have spent forty years dealing with all sorts of computer systems - designing, building, maintaining, repairing, redesigning and rebuilding. One thing I have learnt over that time is that none of the systems ever built has been error free in terms of the logic entailed within them. All to often, I have seen systems that were used to make decisions with and those using them assuming that the outputs were correct or reasonable. Yet on investigation, the logic entailed in them was completely rubbish.
We make assumptions and often we do not carefully check that those assumptions are actually real. I don't trust anything I write until I have gone over it with a fine tooth comb and then I will try to document all my assumptions and this usually shows up various logic errors or conditions that I didn't think about. I don't see this happening much out in the real world.
What do you mean?
AlphaZero was trained entirely on self-play, and is a generic reinforcement learning algorithm. All it starts with are the rules (Chess, Go, Shogi) and a few million games later it beats — so far as I can see from a quick Google — all the humans, and most matches against AlphaGo Zero which learned the same way and which in turn beat AlphaGo Lee in every match, and that (unlike the aforementioned) was trained on examples of human matches in addition to self-play… but still learning from those examples as there's no known useful[0] set of rules that even says if a Go game is over let alone which moves are good.
There are AI which can find and exploit its weaknesses, but I've not seen anyone else suggest humans can defeat it.
> I didn't keep the link for the discussion on the confounding of the Go AI system. What the discussion covered though was that there were simple Go configurations that the GO AI failed abysmally on when playing a human - it didn't learn here.
Do you remember the name of the AI?
A bit of rummaging got me KataGo, but the humans had to use another AI to discover the weaknesses of KataGo rather than figuring it out for themselves.
And yes, KataGo absolutely does learn. The fact you can trivially stop the learning process is a feature not a bug for AI, precisely because it means any safety testing of the sort you're calling for is actually possible (albeit rather different than formal logic).
[0] pathological cases are easy — "board empty == not finished" — but not helpful.
Whose intelligence programmed this system?
> Do you remember the name of the AI?
If I recall correctly - Go AI.
They used a simple regular pattern and the system failed to beat the human. It didn't [learn] from this.
All such systems use a set of rules (whether specific or pattern based or mathematically based - there is some form of logic involved, even when using probabilistic functions), you and I can make choices based on illogical decisions - irrational decisions if you like. No computational system is capable of irrational decisions, the decisions may be surprising but of you look at the code then that option was always there somewhere, It cannot take a path that does not exist.
We can create a completely new path not previously available.
I see.
Well, that's too generic to even be searchable.
> They used a simple regular pattern and the system failed to beat the human. It didn't [learn] from this.
Anything written like that would struggle against an amateur.
The machine learning based Go AI don't do that, and do beat humans.
> All such systems use a set of rules (whether specific or pattern based or mathematically based - there is some form of logic involved, even when using probabilistic functions), you and I can make choices based on illogical decisions - irrational decisions if you like. No computational system is capable of irrational decisions, the decisions may be surprising but of you look at the code then that option was always there somewhere, It cannot take a path that does not exist. We can create a completely new path not previously available.
Whatever standard I use for logical or illogical decisions, wherever I put that line, humans and AI seem to be on the same side.
We have electrical impulses flowing though messy networks, crossing tiny chemical barriers where they can be influenced by neurotransmitters; to me, that's not different enough from information flowing through an artificial neural network with weights and biases that have been automatically modified through feedback after winning and losing millions of games to say that the machine "isn't learning" — or that humans and machines aren't on the same side of "logical", at the fundamental lowest level we can't violate chemistry any more than transistors can violate physics, at the highest level the real logic of each can be random.
AI are inhuman, certainly, but still learning.
…
Just to check, you are aware that the weights and biases of an artificial neural network are basically never set by humans? That this process has to be automated?
You might want to search what articles were discussed here on the subject.
> Whatever standard I use for logical or illogical decisions, wherever I put that line, humans and AI seem to be on the same side
You can make an illogical decision. No computer program can make an illogical decision, though the pathways followed through the code may give rise to something unusual, it still follows the logic written in the program, it cannot do otherwise. Even if you have random values occurring on inputs, the code itself will follow predictable paths. If you write self-modifying code, this too is done in accordance with specific rules.
Your example of neurotransmitters and comparing to neural networks is unfortunately flawed. We developed the idea of neural networks based on a very simplified understanding of what is happening in living neural systems. Our neural network are (whatever you might think of them) extremely simple and follow very specific logical paths. We may not be able to identify what those paths will be a priori but we can analyse what has happened after the event and it will still be based on the underlying logic we put into these systems.
> Just to check, you are aware that the weights and biases of an artificial neural network are basically never set by humans? That this process has to be automated?
Yes. The automatic processes still relies of specific logical rules.
If we use only goto's, we can write all sorts of "unpredictable" programs based on random inputs. Does this generate any intelligence? If we know the code and the inputs, we do have the ability to determine what has happened.
> AI are inhuman, certainly, but still learning
I would say it this way AS systems are simply artificial constructs and the data generated is simply generated and not learnt.
There's a lot of stuff we consider to be "common sense", sometimes those things are used to criticise AI and sometimes they're used to criticise other humans for not knowing them, but that is a category that we don't even think about until we notice the absence.
For the things not considered common sense, like playing chess (beats all humans) or speaking/reading foreign languages (more than I can name to a higher standard than my second language), to creating art (even if it regularly makes the common sense mistake of getting the number of fingers and limbs wrong it's still better and not just faster than most humans), to arithmetic (a Raspberry Pi Zero can do it faster than all humans combined), to symbolic maths, to flying planes…
A dev conference I was at recently had someone demonstrate how they hooked up their whatsapp voice calls to speech recognition, speech synthesis trained on their own voice, and an LLM, and the criticism of the people who got the AI replies was not "you're using an AI" (he had to actively demonstrate his use of AI to conversation partners who didn't believe him) but "you can't have listed to my message, you replied too quickly to have even played it all back."
We make machines that are stronger, faster, and can have much finer motor control than we have as individual abilities. No machine we have created has the dexterity that we have.
Every computational system can be analysed in fine detail to determine the limits that we have built into them. It may take an enormous amount of time and effort to do so, but we can do it. No computational system that we have built is able to exceed the limited programming we place in it.
There is an enormous amount of hype that goes on about the current generation (and future generations) of these systems, but all of them are in the abilities that we have programmed into them. They are in all essentials completely stupid (in the worst possible way - non-sentient, non-intelligent).
Every logic error that we have made in building these systems is hidden in that code. One day, those errors will come back and bite us, but there is nothing intelligent or sentient in these systems. It is our errors, for which we are responsible, that will cause those problems.
We can use them as adjuncts to our sentience and intelligence - but all they are are tools, never anything more.
However, if we cede control to these systems, we are ceding control to something that is no better than fire (a good servant - a horrendous master). After forty years, I have seen far too often, hype by humans convince other humans to cede control to the systems that humans have made and the result has been various levels of chaos.
If anything, what we need to be careful of is how humans use these systems against other humans. This is the perennial problem that we face as we build new technology.
> However, we can enumerate all the things that we create can do.
Not really, no. Even before AI, "Turing Complete" makes things extremely hard to enumerate; see Busy Beaver numbers for how small a system can be and still outside our ability to fully comprehend — needing to use up-arrow notation because exponentials aren't big enough is always good for a laugh.
You example of the Busy Beaver numbers, which was a recent interesting read, is a good example of what I was trying to point out. We have a definition and even if we cannot enumerate each number, we discuss and think about these in a rational way. At the moment, I am quite interested in Computer Algebra Systems (of which there are a variety) and I find it interesting just how limited these systems are and just how difficult it is to program into them the capabilities that humans use to solves various problems. The various discussions have been quite enlightening.
Mathematics is an interesting subject and I think shows up the intractability of ever getting that highly feared singularity.
All artificial computing systems are limited in ways we are not. Your "Turing Machine" example is one such case. The Halting Problem being a class example.
I think that far too often, we fail to recognise that what we create is not that great. We often stand in awe of the things we make without comprehending that these things are a very poor reflection of what is around us and what we ourselves are.
Every time some hype comes about these artificial stupidity systems, I look at my youngest granddaughter and see in her, capabilities that far exceed anything that we have created. Even my old buck of a goat demonstrates capabilities far, far in excess of anything we have created in all of our computational systems.
As I have said elsewhere here, we have to be careful that we do not cede control of our lives to systems that we think are more than they really are - systems that are limited, fragile and prone to failure.
You appear to be asserting that humans can tell if a loop will end, when that loop is defined so that if it does it doesn't and if it doesn't it does.
> Even my old buck of a goat demonstrates capabilities far, far in excess of anything we have created in all of our computational systems.
How so?
Not saying this is necessarily false — GPT-3 is about as complex as the brain of a rodent, so it wouldn't exactly be surprising even though the LLM only does text and completely different AI do other things — but still, what exactly do goats do that's "far in excess"?
We can determine by looking at certain problems (The Halting Problem is one such example) what the outcome will be without actually having to execute that code. The Halting Problem is one of the simpler problems that cannot be solved by computational means, which includes all artificial computational system.
You ask [How so?] to my comment about my goat. I would suggest that to understand this you need to go and observe what happens in the environment with such beasts, whether it be a cow in a local paddock or a pet dog or cat. Take time to observe the interactions that occur and think about how little [training] is involved here.
Watch children around you, take some serious time and observe them in their interactions and I think that when you think about how we program our various artificial stupidity systems that we are still at the caveman stage in our computational systems. We have barely discovered fire so to speak.
As for [GPT-3 is about as complex as the brain of a rodent], I don't think GPT-3 has even reached a single bacterium cell state of intelligence.
I would like you to try the following: Using your index finger on your left hand, touch the tip of your nose.
Now think about this: How did you do that very simple task? When did you learn and how did you learn to do that simple task?
If you think about it carefully, the task that I describes is incredibly complex.
Now what would be required to get an artificial stupidity system (AS) to do the same task? What programming do we need to do to achieve this task? What programming was done to you to achieve that same task?
When you start asking questions like this, it becomes very clear that all of our computational systems (including all of the AS systems) are incredibly simple and not at all comparable to what we find within ourselves.
We can build very useful tools that we can use to good purpose. But no tool is ever more than a tool for us.
I suppose what concerns me about our current state of affairs is that we are far too impressed by our caveman antics. There is not a single industrial system built by mankind that comes close to the integrated control and manufacturing systems found in a single living cell. None of our communication systems come close to what is found in the various control/communication systems found in even the simplest of chordate organisms.
It was very obvious, 40 odd years ago during my engineering undergraduate days, just how fragile much of our technological base was then. It is far more fragile today and yet we appear to be enamored by our [current technological prowess] which is actually far more fragile than it was 40 years ago.
No, we definitely can't do that in general, and that lack of generality is the halting problem.
> Take time to observe the interactions that occur and think about how little [training] is involved here.
Apart from "all of evolutionary history", (though everyone agrees AI are slow learners when counting how many examples they need if that's your point?), there's continuous feedback from pleasure and pain and probably a lot more emotions that don't necessarily map onto any human qualia.
> I think that when you think about how we program our various artificial stupidity systems that we are still at the caveman stage in our computational systems. We have barely discovered fire so to speak.
I'd use a different analogy; dinosaur perhaps.
> As for [GPT-3 is about as complex as the brain of a rodent], I don't think GPT-3 has even reached a single bacterium cell state of intelligence.
I think my Roomba-clone does that: touch an obstacle, back off, rotate a few degrees, go forward again.
Now that, I'm fairly sure was programmed rather than learned (in the robot; still learned in the bacteria via evolution).
> I would like you to try the following: Using your index finger on your left hand, touch the tip of your nose.
> Now think about this: How did you do that very simple task? When did you learn and how did you learn to do that simple task?
How: a network of neurons, if I remember right about 40 deep, integrating mostly proprioceptor input as it's continuously updated when my muscles move.
When: unclear, either as an infant before and autobiographical memories, or genetic (which is arguably "not me").
I'm not sure this matters, either way though, as we do have robots which are navigating entirely by proprioception, and which again learned by training rather than being programmed.
> We can build very useful tools that we can use to good purpose. But no tool is ever more than a tool for us.
When tools stops being mere tools — regards of this is mere perception, or when peasants and slaves revolt, or when (Australia) pest-control animals themselves become pests — we generally have big problems.
I agree the world is more fragile; I don't know if AI will help or not.
That’s called positivism and it has a lot of philosophical issues. I wouldn’t be so quick to assume that sensory appearance is equivalent to reality.
This is a positivistic argument and as I pointed out, positivism has a lot of issues. The best counter argument IMO being that it’s needlessly reductive. This is all covered pretty clearly in the link.
That is not what BoiledCabbage was saying. He was saying: "And what do you feel when we understand it well enough to realize we're the same type of parlor tricks?"
>This is a positivistic argument and as I pointed out, positivism has a lot of issues. The best counter argument IMO being that it’s needlessly reductive. This is all covered pretty clearly in the link.
You're not really making any specific claim about what is wrong with BoiledCabbage's speculation, and why this specific thing is wrong. "That's wrong because positivism, it's all in this 5k word wikipedia article!" just doesn't prove anything.
What’s wrong with the speculation is that it’s a positivistic argument that is needlessly reductive. It’s reductive because it assumes that appearing human-like is equivalent to being human.
The fact that we can understand how “AI” works as a parlor trick yet appears human-like in no way implies that human beings are nothing more than the same parlor trick processes. To argue that it does is to make a positivistic argument that doesn't take in account a whole host of other things. As noted in the Criticism section of the article (which is hardly 5,000 words) there are many issues with this approach.
I don't read that assumption into BoiledCabbage's statement at all: "[..] when we understand it well enough to realize we're the same type of parlor tricks?" This clearly implies a (hypothetical) deeper understanding of processes in the brain and their specific qualities, rather than (as you seem to be implying) a mere comparison of the outputs.
Edit: anyway, the criticism section opens like this:
>Historically, positivism has been criticized for its reductionism, i.e., for contending that all "processes are reducible to physiological, physical or chemical events," "social processes are reducible to relationships between and actions of individuals," and that "biological organisms are reducible to physical systems."
This (at least the 1st and 3rd quoted item, while I think the 2nd one is just out of scope) is exemplary of the kind of things that are obviously true for anyone but a subset of philosophers clinging to magical and unprovable beliefs about the human mind. I asked you to elaborate your argument precisely because if it all boils down to simply rejecting physicalism (in philosophy of mind terms) there's nothing new to argue about. The recurring discussion about "AI can never be like humans" is only interesting when the participants do a little bit more than just staking out their own position in idealism vs dualism vs physicalism terms and regurgitating all the known debates between these camps.
And what do you feel when we understand it well enough to realize we're the same type of parlor tricks?
It seems pretty clearly when and not if. Not sure what you're reading there.
https://dictionary.cambridge.org/grammar/british-grammar/if-...
The comment is written in such a way that it assumes this is the nature of reality and at some point, we will learn that the human mind is no different from the parlor tricks of LLMs. This is what I was criticizing.
Again your whole point seems to boil down to simply denying physicalism (unless you have something more subtle in mind about the limits of physical science). It's a valid position to take but not very fruitful for further conversation.
I disagree.
Thought experiment: design a circuit which has as many inputs and outputs as a biological neurone, such that it always maps inputs to outputs in the same way (including the observation that this isn't a static map but one which changes over time), then connect them as neurons are in one of us.
While clearly nothing like an natural brain on a cellular level, I believe this is a sufficient similarity to be "the same parlour tricks".
The question then is: how close does the design actually need to be, while not losing anything of importance?
Perceptrons were only ever a toy model, so they may well be insufficient; but on the other hand, for a sense of scale, GPT-3 is about the complexity of a rodent brain rather than a human brain — and that suggests that humans could learn to be simultaneous experts in many dozens of fields and languages with a mere tenth of a percentage point of our brains if only we lived long enough to read the entire internet.
Which matters most — neurons, connective structure, learning environment, or something else — is, I think, still an open question. But even between all the differences, AI collectively are general purpose enough to at least suspect these things have got a lot of similarities where it matters.
Self-play is widely used to train game AI, and is the "A" in "GAN"; is there any point doing it on an LLM? Especially on the ones being sold as services where people get upset if they change over time?
It's a season.
Like the seasons, the cycle repeats.
Examples: Graphics User Interface. The iPhone seated mobile compute as a permanent fixture, it and Android bringing internet and computing to billions of humans for the first time. Not just the wealthy industrials. Or IBM DB2 for SQL. Or Ford's Model T. Or the Gutenberg. None of these were the first first. Maybe even on the n-th iteration 2 decades after coming out of DARPA or global university research, something is just ready for commercialized prime time.
Computing was solved by Lady Ada and Babbage. It's all electrical engineering, software, fabrication, productization, mfg, displays, sensors etc. after that.
Semiconductor was a big deal in making it happen. But that's almost besides the point of the theory of compute if it can be solved in other novel ways using alternative material science.
100m people used this latest iteration. It’s hardly a winter.
One example of that is the crypto space. So many actual good for humanity implications, but the "killer app" that made the news was fucking NFTs. I'm trying really hard not to come to the conclusion that humans are just mindless zombies but it's getting harder every year.
Once we reach a billion DAU you can be sure it will just be "Original Memes Tailored Just For YOU"™ instead of figuring out the logistics for solving world hunger. Mark my words.
Do the intrinsic properties of the system really matter at the end of the day if it performs as well as we do at some task? Heck they’ve been doing many things better for decades, but those are the types of tasks we take it for granted that a machine should be able to do. Solve differential equations. Play chess. But now computers are doing “human” tasks competently. Writing creative fiction. Generating graphical art.
We don’t have a good working definition or metric for intelligence. Surely it is not a monolithic property. Animals exhibit many traits we associate with intelligence. Some of the stuff GPT 3+ generates sounds pretty intelligent. It is the type of things an intelligence may have produced, because it was trained to do just that. If we look at intelligence as a cluster of traits, or behaviors, I think we are surrounded by intelligence - human, artificial, or otherwise. Doesn’t have to be an AGI to fall in that category. It doesn’t even have to be particularly impressive.
Same with code. Sure it might not write your product code from start to finish with no help but it will speed up your dev speed significantly for certain tasks. Just because we haven't reached singularity doesn't mean what we have now is useless and putting it down as a "parlor trick" as grandparent said seems to me very unwise.
I have a definition of intelligence. [...]
Intelligence is prediction.
In the case of intelligent living processes ranging from single celled organisms to complex multicellular life, intelligence arises from the need to predict the future to survive and reproduce. More intelligent organisms build more elaborate models of the world using better developed senses in order to do so.
Humans model the world primarily with language, which allows us to share our models with each other, across both space and time! Without language, it is extraordinarily more difficult to communicate complex abstract thoughts. As a side effect of our high level of intelligence, our wetware is capable of modeling things outside of language, such as mathematics. [...]
In general, I think we need to stop equating intelligence with consciousness, agency, moral value, and living things. These are entirely different concepts, and, as a species, we are blinded by our egotistical identity of being smarter than the other animals.
According to my definition, intelligence is actually all around us. We are blind to it because we focus only on how intelligence manifests in humans (defined by by our specific social organization and biological senses), and then use that as a benchmark to judge every other thing in the world.A less socially-charged definition of intelligence would make it easier to compare intelligence across living and non-living processes, though it would not be "popular science" useful for ranking humans.
2 people want to kill each other. The one taking the first step is the intelligent one because according to your definition he was better at predicting an outcome than his opponent.
The real world is more complex than that and there are multiple options where both survive, or letting your opponent live and killing yourself because his life is more beneficial to humanity and so on.
Any organism can survive, but for most (including us) that implies a selfish outlook but the most intelligent people I know or heard of never even consider their own ego.
This makes it useful for judging these properties across living and non-living intelligent processes, such as bacteria, ants, plants, dogs, LLMs, etc. It is not a useful definition for judging the value or "goodness" of human beings within society.
I'm arguing that intelligence (as prediction) is simpler than we often presume, not a mystery at all, and a basic building block of complex life. We happen to have a lot of it.
There are plants that slow their own growth to share resources if their neighbor is of the same species, and vice-versa if it's a different species. That could be called intelligence in a sense, but it's not as simple as just prediction there's a social aspect and a long-term goal. But is it even conscious and aware of what it's doing or is it just the traits favored by evolution. Is agency part of your definition of prediction or is it enough to just react to the surroundings?
Intelligence is much more complex than a single trait. Being good at prediction is just that, being good at prediction.
AI a branch of statistics. Nobody said that statistics must limit itself to linear models of numerical data.
The trick is to get people not to associate the dictum "lies, damn lies and statistics" with "hallucinations, damn hallucinations and AI".
Is ChatGPT playing a trick on us by mimicking the sentience of the humans whose writings it ingested, or is the trick that by doing so it began to actually think like us and so simulates a conscious mind within?
I lean towards the former; but we don't know what sentience even is yet, so we can't prove it.
In terms of actual sentience, understanding
I had chatGPT answer questions in the following order:
1. Describe to me what happens when you throw sugar in coffee
2. Describe the same thing in terms of atoms.
3. Is this an example of entropy decreasing?
4. What if the arrow of time was reversed. Describe what happens again at the atomic level.
5. What if there were two regions in space one with increasing entropy and another with decreasing entropy. I place the coffee cup such that one half is in one region the other half is in the other region. What happens?
Each answer displayed astonishing understanding of what occurs. This was the final answer to the fifth question: -----------------------------------------------
The scenario you've proposed is purely hypothetical and quite speculative because it defies our current understanding of the laws of physics, particularly the Second Law of Thermodynamics, which stipulates that entropy in an isolated system tends to increase. Nevertheless, it's a fascinating thought experiment. Here's what might happen if you had a cup of coffee straddling two such regions:
The Increasing Entropy Region:
Dissolution and Distribution: On this side, sugar would behave as it does in our observable universe. It would dissolve in the coffee and disperse randomly throughout the half of the liquid.
Mixing and Thermal Energy: Molecules in this region would continue to collide and interact based on thermal motion, contributing to faster dissolution and dispersion of sugar.
Sweetening: The coffee in this half would become sweet as the sugar molecules interact with the liquid and dissolve.
The Decreasing Entropy Region:
Reforming Crystals: On this side, dissolved sugar would spontaneously start forming sugar crystals, leading to a decreasing level of entropy.
Unmixing: The sugar would start to separate from the coffee and move to form a distinct layer or solid chunks, further decreasing entropy in that half.
Unsweetening: Any sweetness initially imparted to this side would disappear as sugar molecules revert to a more ordered state.
Challenges:
Interface: The most mysterious part would be at the interface where the two regions meet. Would a sugar molecule crossing from the increasing to the decreasing entropy region suddenly reverse its course? Would there be some form of "entropy gradient" or "entropy tension" at the boundary? This part is extremely speculative and likely paradoxical.
Energy Conservation: Energy conservation laws might become complicated here. The energy required for sugar to crystallize in the decreasing entropy zone would have to come from somewhere, and how this balances with the increasing entropy side would pose a significant scientific puzzle.
Thermodynamic Anomalies: The coffee cup itself would be under very peculiar thermodynamic conditions, subject to two entirely different sets of rules. The temperature might behave inconsistently across the boundary, and heat exchange would likely be disrupted in perplexing ways.
Taste Experience: If you were to taste the coffee, each half of the cup would offer a radically different experience, one sweet and the other likely reverting back to its original unsweet state.
Perceptual Paradox: From a human perception standpoint, witnessing sugar both dissolve and crystallize in the same cup of coffee would be a profound and likely disorienting experience.
Time's Arrow: This set-up implicitly questions the nature of time itself. Time seems to behave differently on each side, challenging our deepest notions about causality, sequence, and even reality.
Again, it's worth noting that this scenario conflicts with our current understanding of physics, but it's a fascinating avenue for speculative thought. Such a universe, if it could exist, would fundamentally challenge our understanding of physical laws and reality as we know it.
-------------------------------------------------
This answer here is anything but a magic trick. It shows deep understanding of conceptual reality by answering complex questions that are unlikely to exist anywhere else on the internet. The AI literally talked about the mysterious interface without me prompting it at all. It knows the conceptual consequence of two regions of space side by side with differing levels of entropy. The answer is not simply a trick of the next best language token.Is it a practical answer? No. Because the question itself isn't practical. But a non-practical answer does not make this answer a parlor trick.
The entire internet is dismissing this thing as a parlor trick because LLMs fail to add large numbers. I mean come on man. You don't need to be able to do math like a calculator in order to "understand" things.
AI is not yet completely practical. That much is true. However, it is clearly No longer a parlor trick and it is getting closer and closer to transitioning into practical. When that day comes.... Good luck to us all.
That said, I agree with your arguments and conclusions. Humans are not able to do this kind of reasoning until they have had some education on the topic - and when they reason they get feedback to reinforce their conclusions if others agree or they get a more rigorous proof. We could do the exact same thing with an LLM. Would that potentially make a reasoning AI? For me the jury is still out, albeit I think we need better algorithms for it to be feasible.
But the interface is unique. That is not a topic widely talked about at all.
Question:
Instead of two regions add a third region where entropy of the particles entering the region will always stays the same no matter what. Place the coffee cup such that it is in all 3 regions equally. Describe atomically what happens.
Answer: --------------------------------------
In this fictional universe where regions have varying entropy behavior, the coffee cup sits at a tri-junction: a third of it is in a region of increasing entropy (Region A), another third in a region of decreasing entropy (Region B), and the last third in a region where entropy remains constant (Region C).
In the Atomic Realm: Region A (Increasing Entropy):
Sugar molecules randomly move throughout the coffee, driven by thermal motion. They strike water molecules and dissolve over time, eventually reaching a state of homogeneous distribution. The entropy of the system in this portion of the cup increases as expected.
Region B (Decreasing Entropy):
Astonishingly, sugar crystals spontaneously form in the coffee. Sugar molecules collide with water molecules and join an ever-growing crystalline lattice. Over time, the sugar becomes a distinct entity in the coffee, and the entropy of this system decreases.
Region C (Constant Entropy):
The sugar neither dissolves nor crystallizes. Instead, sugar molecules and water molecules co-exist in a dynamic but unchanging equilibrium. At the atomic level, every dissolution event is perfectly balanced by a crystallization event, maintaining constant entropy.
The Tri-Junction: Molecular Exchange:
Some molecules, through Brownian motion, will wander across the boundary lines dividing the three regions. Entropic currents from Region A and B cross into Region C and are balanced out, maintaining a zero net change in entropy in that region. Special quantum-entangled pairs straddle the boundaries, existing in superpositions of increased, decreased, and unchanged entropy states.
Entropic Flux and Balance:
A constant entropic flux is established between the three regions. The entropic gradient tensor now has a third component, and the entropic flux density vector also adjusts to a tri-vector to balance out the exchange between the three regions.
Localized Time Anomalies:
At the atomic level, it's as if time runs forward in Region A, backward in Region B, and is somehow "static" or cyclical in Region C. Particles appear to remember both their past and future states in Region C, generating a unique form of atomic "temporal coherence."
Causality and Quantum Superposition:
Despite these anomalies, causality is preserved. Particles that cross into different regions adapt to the local entropy behavior and exhibit quantum behaviors that align with the local direction of time.
In essence, the tri-junction becomes a hotbed of bizarre but mathematically consistent phenomena, a place where the fabric of spacetime and the fundamental laws of thermodynamics seem to negotiate a delicate truce.
As for the cup of coffee, one-third of it will end up well-mixed, one-third will have sugar crystals, and the last third will remain an intriguing paradox of thermodynamics. You might call it the most scientifically fascinating cup of coffee ever brewed.
-------------------------------------------------
This isn't a parlor trick regurgitation. It's displaying understanding of the concepts by speculating on new concepts via composition of several other concepts.However, it does not really say much. In particular the "Localized Time Anomalies" section for region C seems to be a hallucination and from there on, it really sounds like something a science writer, without the proper education, could have written.
It sounds good, but from an experts view, it is at best a popsci introduction to the subject.
It just flew past your head didn't it? You remarked on the similarities between an AI and a human in order to prove the triviality of AI.
Getting AI to the ability of a science fiction writer was an impossible feat just 3 or 4 years ago.
The responses are based on the accumulated knowledge of humans and not machines. The systems have not thought through anything and understand nothing. A process of analysing or pattern matching the input question with the data stored retrieves an answer. But that data stored is human knowledge and human effort not machine.
If you look very carefully at the results obtained, it either contains "interesting errors" (for which an intelligent human would pick up) or it is a summation of human knowledge.
The answers still have to be tested and confirmed for rationality and applicability by humans. In other words, this is a tool like all tools created by humans.
I have seen too many examples of what are supposed to be correct answers that contained subtle and not so subtle errors.
Like every system we have ever made, Garbage in gets us Garbage out. We are the ones responsible to checking those answers and making sure that they make sense in the real world.
The answer is obvious. The LLM is understanding the concepts. The last question was unique. The resulting answer was also unique.
It was not a "retrieved" answer. It was a unique answer. A correct composition of several underlying concepts. A correct composition can only be formulated if the machine had correct understanding of each concept and how they relate to one another.
This thing understands you. It wholly owns this understanding. It is not regurgitating knowledge. It is inventing new answers.
Wake up man. I had the LLM invent 6 regions and heat the cup of coffee to plasma levels of heat. The answer and composition of concepts was remarkable.
You're calling it a parlor trick because of subtle errors? Bro. Come on.
Gpt Othello is a good discussion about this that's more constrained too.
Who created the LLM? Whose understanding underpins the LLM?
Certainly not the LLM.
> This thing understands you.
Does it? Or is this a result of the intelligence of the human beings involved in building the LLM?
> I had the LLM invent 6 regions and heat the cup of coffee to plasma levels of heat.
Did the LLM actually invent anything? Or was this result directly based on you and your intelligence with the recorded knowledge of all the human sources involved in the solution?
> You're calling it a parlor trick because of subtle errors?
I haven't called it a parlour trick. All I am saying is that there is no intelligence in these systems. Human intelligence built them, but these systems in and of themselves have no intelligence.
We do of course build many intelligent systems all the time, they are called children.
Who created you? Whose understanding underpins you? Asking these questions about you is as irrelevant as asking it about the LLM.
Just because books, educations your teachers, the internet and your parents and the environment shaped everything you know doesn't preclude your membership into the category of things that are capable of understanding.
>Does it? Or is this a result of the intelligence of the human beings involved in building the LLM?
It does understand you. The intelligence of human beings who built it aren't directly involved as it was trained on external data.
>Did the LLM actually invent anything? Or was this result directly based on you and your intelligence with the recorded knowledge of all the human sources involved in the solution?
Does a human actually invent something or is it directly based on recorded knowledge?
You're asking irrelevant questions. Humans do not create things out of thin air either. Humans also invent things by composing existing knowledge to form concepts. The inventing that LLMs can do is equivalent in totality to our understanding of the word "invent"
>I haven't called it a parlour trick. All I am saying is that there is no intelligence in these systems. Human intelligence built them, but these systems in and of themselves have no intelligence.
Totally false. Not only are you wrong but experts in AI including the father of modern AI disagree with you completely and utterly.
If I copied your brain and replicated exactly that brain is "from human intelligence" but that copy of your brain is still an intelligence independent of it's origins and where it got it's knowledge.
>We do of course build many intelligent systems all the time, they are called children.
It's like you're eating your own logic. We also build intelligent systems called LLMs. Same concept.
Let me put it this way: Humans are started with a single cell that eventually grows into an extraordinarily complex entity. If you look at new born babies, they have a capability of learning and exploring that we do not see in any artificial construct that we make.
Our artificial constructs have to be essential fully developed physically before we can then start the process of programming them. Humans have a capability to learn as they develop. We see this occur in all living things.
There is a fundamental insurmountable category difference here between living things and artificial constructs that we make.
Any appearance of understanding is based on the logic that we program into these artificial constructs. They cannot exceed what is programmed into them. Interestingly, living organisms can often exceed that. I think that all programmers should undertake a study of living things to gain a greater appreciation of what we do and just how simplistic are the things we do. That is a particular philosophical point of view that I hold.
I think that your appreciation of what we do and the constructs we create is not in accordance with reality. Not that this is particularly strange as far too many people have a much higher view of our technological prowess, especially when comparing to what has gone before. Starting from my undergraduate engineering days and the ongoing study of engineering and technological history, it has become quite clear that we are often today, quite ignorant of just how technologically advanced previous eras were in all sorts of different areas. There are plenty of research groups that are researching how previous generations were able to do things that we do not know how to do today.
> Does a human actually invent something or is it directly based on recorded knowledge?
Here, we do know that there is at least three ways that invention can arise. Logical progression on recorded knowledge, imagination as to how to solve a problem (thinking outside of the box), observation of the natural world around us.
> You're asking irrelevant questions.
For you to say that the questions I asked were irrelevant shows that you have limited yourself in your pursuit of knowledge and understanding.
> Humans do not create things out of thin air either.
When thinking outside of the box, they do. But I suspect that you may not appreciate this particular point.
> Humans also invent things by composing existing knowledge to form concepts.
As pointed out above, this is one mode of invention.
> The inventing that LLMs can do is equivalent in totality to our understanding of the word "invent"
Here, I disagree with you. But that is very likely to be a philosophical/metaphysical difference between us.
> Totally false. Not only are you wrong but experts in AI including the father of modern AI disagree with you completely and utterly.
Do you understand that you have devolved into a fallacious argument here? This is a seriously flawed fallacious argument on your part. The problem here is that your argument assumes that these [experts] you are referring to are correct, when you have not demonstrated that. Nor have they. There are many experts and others (all highly intelligent and talented people) who for all their intelligence and talent are just wrong. This has been shown to be the case many many times throughout the last century (let alone before that) when our understanding has changed because some little known person has come up with anew idea. One of the best examples here would be someone you would know of - Albert Einstein.
Now when you say
> If I copied your brain and replicated exactly that brain is "from human intelligence" but that copy of your brain is still an intelligence independent of it's origins and where it got it's knowledge.
Here, you have a problem. What is the difference between a living brain and a dead brain? In a single instant, we go from life to death and yet we don't know at this point in time what that difference is. There are lots of experiments being done today which are trying to study if there is a non-physical aspect to intelligence and free-will. Different experimenters in the same team have quite different interpretations of what the data means.
Do be so quick to assume that you know, when the researchers who study this can't agree.
> It's like you're eating your own logic. We also build intelligent systems called LLMs. Same concept.
Not at all. Intrinsically different and there is a vast categorical difference between children and our artificial constructs. From your comment, is it a valid assumption that you do not have children of your own or grandchildren of your own or even pets?
Let me ask a question, what is your background in building systems that augment human capability? If you have been involved in building LLM's, let me know.
Irrelevant. How something was created or formed is irrelevant to the intelligence it possesses.
>Our artificial constructs have to be essential fully developed physically before we can then start the process of programming them. Humans have a capability to learn as they develop.
Wrong these things are not programmed. They are "trained" and fed information through a "learning" algorithm. Humans also learn through an algorithm.
>We see this occur in all living things.
False. Plants do not learn through any neural process. There are classes of invertebrate known to have nervous systems that do not learn. Jellyfish for example.
>Here, we do know that there is at least three ways that invention can arise. Logical progression on recorded knowledge, imagination as to how to solve a problem (thinking outside of the box), observation of the natural world around us.
Your thinking is not deep enough. You think of "imagination" as some wonderful magical thing. It is not. Imagination is a mechanical algorithm. Imagination is simply a composition of your existing knowledge it has the option to be seeded by random noise. LLMS display all of this.
>When thinking outside of the box, they do. But I suspect that you may not appreciate this particular point.
False. Utterly false. You do not understand the human brain. The human brain is built out of atoms. Those atoms composed form neural cells. Those cells composed form neural circuits and those neural circuits composed form the brain. All of it is a tool of immense complexity that is only seemingly magical but is bounded by the laws of physics.
With enough computing power a computer can simulate an atom, simulate the composition of atoms into a neuron, simulate the composition of neurons into neural circuits and finally the brain. With enough computing power therefore the computer imagines things too with a full simulation of a human brain. It's just follows from the logical interpretation of the laws of physics.
However LLMs are an attempt to bypass a full simulation that is ultimately too detailed. We can model the inputs and outputs of a neuron without simulating atoms. It's simply a function with numerical inputs and a single output and we can compose those with much less computing power. That is essentially what modern AI is. The difference is we aren't sure how the neurons connect even though the neuron itself is an accurate model of the real thing. Thus we rely on simplified models like the LLM to model intelligence.
>For you to say that the questions I asked were irrelevant shows that you have limited yourself in your pursuit of knowledge and understanding.
No I have not. The questions I ask are much deeper than yours. Your problem is that you classify things as "magical" like "imagination" without thinking about what "imagination" is. With thought you will realize that all things can be drilled down to a mechanical explanation based on physics and the "magic" of intelligence is a problem with our inability to cohesively understand complexity of the interplay between multitudes of billions of components. The "magic" is an illusion you interpret incorrectly.
>Here, I disagree with you. But that is very likely to be a philosophical/metaphysical difference between us.
Your disagreement is irrelevant. You are incorrect and your statement is false in the context of reality. Whether you disagree with that or not is, again, irrelevant. Metaphysics is bullshit. The only thing observable is physics, if you can't observe it you can't confirm if it's real. What is the point of even talking about it? You can just make anything up. Stay in the zone of what's concrete because that it literally all we know.
>Here, you have a problem. What is the difference between a living brain and a dead brain? In a single instant, we go from life to death and yet we don't know at this point in time what that difference is. There are lots of experiments being done today which are trying to study if there is a non-physical aspect to intelligence and free-will. Different experimenters in the same team have quite different interpretations of what the data means.
We do know the difference. In the process of dying, brain cells undergo a series of complex changes largely due to a decrease in the supply of essential nutrients and oxygen. As organs like the heart and lungs falter, the brain struggles to maintain its energy-intensive functions. Cells can no longer produce adequate levels of ATP, the molecule essential for energy, leading to an energy crisis within the brain.
This energy failure causes a cascade of detrimental events, starting with ion imbalance. Brain cells have finely tuned mechanisms to control the concentrations of ions like sodium and calcium. However, when energy levels drop, these mechanisms fail, leading to toxic levels of ions within the cells. This ion imbalance further leads to the collapse of the membrane potential, a voltage difference that is vital for cellular function.
As cells lose their ability to regulate internal conditions, they might also release neurotransmitters erratically, potentially causing uncontrolled activation or inhibition of neighboring cells. At the same time, the lack of oxygen triggers oxidative stress, which causes damage to cellular components like membranes, proteins, and DNA. This damage can initiate inflammation, worsening the situation.
Finally, cells may reach a point of irreversible damage and activate their self-destruction protocols, such as autophagy and apoptosis, or succumb to necrosis—a form of cell death characterized by the sudden and catastrophic breakdown of cellular structures.
While there are circumstances where medical intervention or other conditions might delay these processes, they are usually irreversible once they've reached a certain point. The journey of a dying brain cell is a complex cascade of events, illustrating the fragility of life at the cellular level.
Researchers all agree. The interplay of all these billions of events form a macro phenomenon called death in which a number of things can happen. We can't explain all the things simply because while we understand the building blocks we don't fully understand the interplay between billions of building blocks. But we do know that the interplay is STILL bounded by the laws of physics. You can make shit up about metaphysics, but that's unobservable and therefore completely speculative conjecture.
>Not at all. Intrinsically different and there is a vast categorical difference between children and our artificial constructs. From your comment, is it a valid assumption that you do not have children of your own or grandchildren of your own or even pets?
Invalid assumption. Not the first time your wrong. But proof your argument is highly fallible.
The failure in your intelligence is in viewing systems as a mechanistic hole. You lack the ability to see how the macro phenomena of life is the formation of physics equations of interacting atoms forming molecules, forming DNA, forming cells, forming neurons. We have equations for atomic physics, we know chemistry and we know how cells are built from atoms and chemistry and we that the brain is built from cells following the same chemistry.
That is your problem. Instead you see magic you can't explain. You've never even wondered about it, never even tried to think deeper to get to the bottom of it or the truth. You just see a little baby do something immensely clever and cute and emotion overwhelms your rationality. You are unable to see the true nature of things that children at the same time being things you love are also collections of atoms going through billions of chemical reactions a second forming this macro phenomenon called "life" and ultimately your kid.
I can see your type. Even things like "emotions" for you are "magical" parts of the human experience that can only be attributed to things like "god" or the "soul". But there's raw evidence against this. Emotions can be removed mechanically. You can target sections of the brain and remove specific emotions. https://www.wikiwand.com/en/S.M._(patient)
It goes to show that if emotion can be removed then logically it is likely that imagination can be removed to. We can go further, did you know that Machines can interpret your minds eye?
https://www.smithsonianmag.com/smart-news/this-ai-used-brain...
It goes to show how similar machine intelligence is to the human brain if it can partially interpret what moves through it.
I have been giving further thought to your responses and what I am seeing is that you hold a particular naturalistic epistemological worldview. This shows up with such statements as:
> Irrelevant. How something was created or formed is irrelevant to the intelligence it possesses.
> Wrong these things are not programmed. They are "trained" and fed information through a "learning" algorithm
and then you disagree with yourself while still keeping in the same naturalistic epistemological framework with
> False. Plants do not learn through any neural process. There are classes of invertebrate known to have nervous systems that do not learn. Jellyfish for example.
If you actually went back and looked at my discussion, I simply gave an example of chordate structures being beyond anything artificial constructs that we make. In addition, I did make the point that these artificial constructs had less intelligence than a single cell organism.
In regards to your saying that [How something was created or formed is irrelevant to the intelligence it possesses], you would have to show with fairly detailed evidence that this claim of yours has a possibility or is the best explanation for what you see.
You have not actually said anything as yet to support your conjectures and to have nullified my evidence for my claims. In fact, when I have asked you to answer some relatively simple questions, you dismissed them as irrelevant without providing any reasoning as to why those specific questions are irrelevant.
What is interesting is that your response to my question in relation to a living and dead brain you say:
> We do know the difference. In the process of dying, brain cells undergo a series of complex changes largely due to a decrease in the supply of essential nutrients and oxygen. As organs like the heart and lungs falter, the brain struggles to maintain its energy-intensive functions. Cells can no longer produce adequate levels of ATP, the molecule essential for energy, leading to an energy crisis within the brain.
But here we see you miss a very important condition. If what you say is true, then resuscitation would be impossible and we do have examples where resuscitation has occurred and occurring long after these processes would have started and in some cases have completed.
Now again you make a fallacious claim when you say:
> Researchers all agree.
Here you are arguing from the fallacy of authority and you are not at all demonstrating that this is the case for ALL researchers in this field.
It is interesting that you say of my arguments and position that:
> Invalid assumption. Not the first time your wrong. But proof your argument is highly fallible.
You make a claim and yet do not actually address any argument I make. The best you seem to be able to do is say something like:
> The failure in your intelligence is in viewing systems as a mechanistic hole. You lack the ability to see how the macro phenomena of life is the formation of physics equations of interacting atoms forming molecules, forming DNA, forming cells, forming neurons. We have equations for atomic physics, we know chemistry and we know how cells are built from atoms and chemistry and we that the brain is built from cells following the same chemistry.
Within the above comment, you make claim after claim and yet provide nothing of evidence to support that claim. I do understand that young people today are not taught how to present their position and arguments in a coherent manner. That particular facility was evident when I was passing through my undergraduate years 40 odd years ago.
Again, what you are showing us all is your particular naturalistic epistemology. You having that is not a problem, but you required to defend that position clearly and logically, which you are not doing.
Now, the other thing that is interesting her is that you make a very specific claim with:
> Instead you see magic you can't explain.
and in doing so, you have only demonstrated that by using the term [magic], you have placed yourself as being the [magic] believer. To discuss this would require an entire different forum. I do find it necessary to point this out to you.
You then claim:
> You've never even wondered about it, never even tried to think deeper to get to the bottom of it or the truth. You just see a little baby do something immensely clever and cute and emotion overwhelms your rationality. You are unable to see the true nature of things that children at the same time being things you love are also collections of atoms going through billions of chemical reactions a second forming this macro phenomenon called "life" and ultimately your kid.
and actually show me that it is you who has failed to think deeply the subject. There are so many questions that you have simply brushed away and you have allowed yourself to think shallowly about what you see. There are many many things that are being investigated by the methods of scientific investigation. The problem that is being found in all sorts of areas is that we see anomalies arising that cannot be explained by our current crop of theories and models. This is actually normal and the basic idea that we have to adjust to is that none of our theories or models is correct. They are all wrong.
The exciting part here is that with more data collected, we have the opportunity to see if there are better theories and models that explain what we see.
I have had a fascination with the electron. Interestingly, in the last hundred or so years, a variety of models have arisen which did not gain traction at the time. Yet today, these models have a possibility to explain what we do see better than the current crop of consensus models.
It is an exciting time to be alive as we can see the potential for breakthroughs in understanding and knowledge. Where we have to be careful is not to get caught up in the hype that does occur. Artificial Stupidity systems are one such area where the hype is extraordinary and the reality is actually being missed.
If you want to think that such systems are intelligent then do so. But you have an enormous uphill battle to prove that. I have thought of a number of questions for you to investigate, but as you have already shown me that you consider such questions as irrelevant, I won't put them before you.
Now as to the URL's you mentioned, the first gives a Cross-Site Scripting error (potential attack), so I won't follow that up.
The second URL to the Smithsonian Magazine, gives an example of data analysis of brain scans. Interesting but not at all to the level you imply with your comment:
> It goes to show how similar machine intelligence is to the human brain if it can partially interpret what moves through it.
In fact, the analysis, though very interesting does not show that it is due to machine intelligence. I have spent years analysing data, building analysis systems and having discussions with other people who are involved in machine learning. The intelligence exhibited is human and not machine. It boils down to something very simple, the only reason these systems exist is because we make them. They have not come about without human intelligence and they cannot progress without human intelligence directing that advancement.
I agree that such systems can be used to augment our abilities, but they don't replace us as our intellectual equals or masters. If we cede control to these unintelligent systems, we then bear the consequences of these systems failing. They will fail and spectacularly at that. If you have any practical engineering background, you will already know that.
So be of good cheer and watch carefully as things develop.
No need to dispense with this bs. Just talk your point.
>> Irrelevant. How something was created or formed is irrelevant to the intelligence it possesses.
>> Wrong these things are not programmed. They are "trained" and fed information through a "learning" algorithm
>and then you disagree with yourself while still keeping in the same naturalistic epistemological framework with
Where the hell is the disagreement? If I used magic to create the same neural network it would STILL be intelligent. How something was made intelligent is irrelevant to the fact that it is intelligent. I am simply correcting a wrong statement you made about how LLMs are created.
>Here you are arguing from the fallacy of authority and you are not at all demonstrating that this is the case for ALL researchers in this field.
You're being pedantic. Majority to the point where nearly ALL researchers agree.
>You make a claim and yet do not actually address any argument I make. The best you seem to be able to do is say something like:
You assumed I had no children. Utterly wrong assumption. The subject of the claim is made in reference to the context in which the statement is replying to. Common sense should be able to help you figure that out. Apparently you made an error here.
>and actually show me that it is you who has failed to think deeply the subject. There are so many questions that you have simply brushed away and you have allowed yourself to think shallowly about what you see. There are many many things that are being investigated by the methods of scientific investigation. The problem that is being found in all sorts of areas is that we see anomalies arising that cannot be explained by our current crop of theories and models. This is actually normal and the basic idea that we have to adjust to is that none of our theories or models is correct. They are all wrong.
You'll note my claim is actually fully correct. You didn't deny that. You think "magic" is part of intelligence.
Anomalies aren't worth discussing because by nature of the word, we don't understand what's going on. Everything discussed here is speculation. Logically Analyze the world based off of what we know for the most likely answer.
>It is an exciting time to be alive as we can see the potential for breakthroughs in understanding and knowledge. Where we have to be careful is not to get caught up in the hype that does occur. Artificial Stupidity systems are one such area where the hype is extraordinary and the reality is actually being missed.
What I see mostly is artificial stupidity being in denial. Adamant beliefs that LLMS display zero intelligence and are regurgitating facts when the proof of novel answers is right in front of your eyes.
>If you want to think that such systems are intelligent then do so. But you have an enormous uphill battle to prove that. I have thought of a number of questions for you to investigate, but as you have already shown me that you consider such questions as irrelevant, I won't put them before you.
It's already been proven. The stupid part is convincing the people refusing to believe factual data. The text I posted is already logical proof.
>The exciting part here is that with more data collected, we have the opportunity to see if there are better theories and models that explain what we see.
So? The current crop of knowledge provides the best explanation we have. Just because you speculate on the potential of future data to rewrite existing ideas doesn't change that. Our current best and most likely explanation is based off of current data. You go speculating into metaphysics it becomes ideas based off of nothing and no data. Go with the best.
>In fact, the analysis, though very interesting does not show that it is due to machine intelligence. I have spent years analysing data, building analysis systems and having discussions with other people who are involved in machine learning. The intelligence exhibited is human and not machine. It boils down to something very simple, the only reason these systems exist is because we make them. They have not come about without human intelligence and they cannot progress without human intelligence directing that advancement.
Utterly wrong about researchers. https://mitsloan.mit.edu/ideas-made-to-matter/why-neural-net... Father of modern AI who revolutionized AI knows these things are intelligence.
Who cares about direction or advancement? These systems are still displaying intelligence independent of that. The intelligence exhibited is only human if it arises from a human. If it comes out of a machine, it's machine intelligence. These are just a ploy on words. You want to define intelligence as something that requires no external manipulation to create. Most people do not define intelligence that way.
>I agree that such systems can be used to augment our abilities, but they don't replace us as our intellectual equals or masters.
you're blind. Do you not see the trendline in how they are augmenting and replacing more and more of our abilities? You follow that trendline the ineviteable replacement is there.
>If we cede control to these unintelligent systems, we then bear the consequences of these systems failing.
Nobody is stupid enough to cede control yet. What are you gonna have chatgpt control your car via language commands and have that thing drive your kid to school. Nobody is stupid enough to do that.
What people are too stupid to realize is that the gap is closing. Right now you can get into a car in San Francisco and have that car drive you to a destination with No driver. Where do you think that trendline will go?
> They will fail and spectacularly at that. If you have any practical engineering background, you will already know that.
As I said at the current state, the most practical thing an AI can do is drive you around San Francisco. If you had any engineering background you'd know that systems fail, but they are fixed and changed and eventually they reach a point where they rarely fail. The driverless AI is getting heading towards that future and so are LLMs.
>So be of good cheer and watch carefully as things develop.
My advice to you is to Think critically because it is sorely lacking here.
They're not just retrieving stored text like pulling the most relevant passage from a database. If they were they'd not be able to deal with things outside the training set. They couldn't write code for a custom library that was created after the cutoff (they can with a description), and they couldn't write about terms made up in the question.
When you use the term "custom library" that might be you over-complicating the task. It's still just looking up function to do x, function to do y and applying it to the output. Don't get me wrong it's impressive where we're at but there's no need to exaggerate it as magic.
I mean no, no it isn't.
I'm giving it info on how to construct data models with a custom library, so interacting with that is not using anything previously stored, and then giving it businesses/tasks to model as simple human descriptions.
If you tell me that something which
* Takes a human description of a problem
* Describes back to me the overall structure and components required to solve it with a hierarchy
* Converts that into code, correctly identifying where it makes sense for an address to be contained within a model or distinct and referenced
* Correctly reuses previously created classes that are obviously not in its original dataset
has no understanding or reasoning and it just regurgitating things it's seen before simply mashed together, I don't know what to say.
Frankly
> it's taking several based on probability and merging them into what it thinks we're looking for. I
Sounds pretty much like understanding and reasoning to me.
> but there's no need to exaggerate it as magic.
I'm absolutely not saying there's magic. Humans aren't magic and they can do reasoning. I'm saying it's not just looking up text and regurgitating it.
I think this is supported by things like othello-gpt, which builds an internal world model and outputs based on that.
It's impressive that it knows the difference between "how many are 5 more apples than 10" compared to "how many percent are 5 apples of 10" (I don't know if it does, just assuming). But the first release also tried to reason why the weight of 1 pound of nails depends with the simple prompt "how much do 1 pound of nails weigh". That's most likely a perfect example of it mashing the classic "what weighs more, 1 pound of nails or 1 pound of feathers".
It IS just looking in a database, and mashing it with some fluff. I'm happy to be proven wrong but I need more than your word for it. My experience is that as the topic gets more niche (less data in the training set) the worse the answers I get and it starts making things up based on probability. It doesn't reason in the sense I assume you're expecting.
It's a nice constrained example of a transformer learning a world model, not just looking up responses.
> It's impressive that it knows the difference between "how many are 5 more apples than 10" compared to "how many percent are 5 apples of 10" (I don't know if it does, just assuming). But the first release also tried to reason why the weight of 1 pound of nails depends with the simple prompt "how much do 1 pound of nails weigh". That's most likely a perfect example of it mashing the classic "what weighs more, 1 pound of nails or 1 pound of feathers".
Is there a formulation here that would get to a point where you'd think it's not just mashing things together? Are there elements of a simple question that would be required?
Here's a slightly trickier one for it "Which weighs more, a pound of feathers or balloons made from one pound of rubber then filled with 100g of helium?"
https://chat.openai.com/share/b841c96f-e46c-4adf-8ec3-8778ff...
It uses context to figure out we're trying to convert something to something else. Then it adds all those numbers up. Taking helium into consideration is no doubt interesting, but they've also polished that task since that was the common critique they got so very wrong with the first release (which I mentioned they had fixed). This comment[1] has a very impressive example. But anything I'm qualified to assess has mostly been meh. If the fix is better training data does that mean it's reasoning or regurgitating? The mistakes it makes are what tells me how it works, not when it tricks me that it's correct. To me it's a very well polished search engine summary.
> Why doesn't it tell me how much air it displaces under what circumstances?
You can ask it and it'll answer.
> If the fix is better training data does that mean it's reasoning or regurgitating?
More training data helps with things you can just bring to the fore, same as a lot of learning. More useful training data though can also help reasoning, which makes sense - deliberate training of people helps improve their logical reasoning capabilities. I know that doesn't guarantee that's what LLMs are doing but humans benefit significantly from both more teaching and better teaching.
> Very impressive, but is it any more original than classic search engines' old trick of regular expressions to figure out if I mean the currency or weight when I ask "1 pound =" with the contexts USD or kg after "="? Does it understand the input, or are there just enough discussions in the training data to make it look like it is?
I'd be interested to know any requirements around this to clearly show the difference. I tried asking what if I filled a balloon at a childrens party with a gas made of atoms that have 1 proton and 100 neutrons: https://chat.openai.com/share/71224df4-5c6c-45f7-88fd-eec316...
(tl;dr: "In the context of a child's birthday party, introducing such a balloon would be a grave mistake.")
It identifies:
* Whether it would float or not and why * That it would be radioactive, and likely types of radiation from it * What that would mean to the balloon * How people would react and the likely consequences of releasing it in a room of children
This is an element that does not exist, in a setting where nothing like this has happened before, with details ranging from types of decay, consequences and human emotional reactions to something like this. Yes, there are real things you can use as a base (e.g. how do people respond to events that kill people), but I feel it's an example of where it's beyond a search engine summary.
I skimmed it and read the conclusion, and it looks interesting, will take a closer look when I have time.
The prompt covers a subject that goes completely over my head so I can't tell how well it reasons. I don't know what 1 proton to 100 neutrons means, but I gather it's radioactive. I don't think it's far fetched that it draws the same conclusion from the training set because to you it seems obvious, and is probably well known to anyone who knows the subject. Kind of like it would understand that "hotter than the sun" is super hot, can correlate to different melting points. But I wouldn't say it understands the concept of temperature. Given the right prompt it might give you the impression it does.
The feelings of the scenario reads like any PR comment after a tragedy. "We feel shock and disbelief" and so on. The scenario being hypothetical doesn't change that since it's probabilities. It acts just like you'd think it would. The earlier example with the helium balloon is similar, it assumes a human context and not the form, and environment the helium is in. True intelligence might not even consider the presence of atmosphere as the norm. "It has no weight outside of your human constraints" would be novel.
Lets say it has odd numbers between 1-9 in the database. Given the prompt 2 and 8 you will get back 1,3,7,9, sprinkled with some natural language and we get the impression it's intelligent.
Are you saying it understands the effect the neutron to proton ratio has, as opposed to just comparing the vectors closest to your prompt that it builds the answer from? Being tested on new and hypothetical examples only means it will be further from the vectors but still close enough to give us the impression it understands the subject. If the training data didn't include the words neutron or proton it would have no idea where to begin.
In my first comment that started this chain I said:
> I don't see why not. It's not taking a single answer from a database no, it's taking several based on probability and merging them into what it thinks we're looking for.
I don't think even this latest answer is any proof of anything other than that. Are you claiming there is? And what are you claiming is happening?
I'm claiming that it's reasoning through the problem.
> True intelligence might not even consider the presence of atmosphere as the norm
I hugely disagree, that's not how an intelligent human would answer the question, and if it did this people would be complaining that it clearly doesn't understand the human context in which the question was likely asked.
> I don't know what 1 proton to 100 neutrons means, but I gather it's radioactive.
It would be hydrogen, but a type of hydrogen that doesn't appear in nature. It's a deliberately absurd example so that it's not in the training set. Its answers are different if the question involves tritium which while radioactive has a moderate half-life and wouldn't immediately pop the balloon.
> I don't think it's far fetched that it draws the same conclusion from the training set because to you it seems obvious,
Only because I can reason through what would happen, not because it's something I've seen talked about before.
To figure out what it would do, it cannot rely on an explanation elsewhere, it needs to first identify that the ratio of protons to neutrons is extreme. Then it needs to understand that this typically results in particular kinds of radiation.
It has to then use that information to consider how that would interact with the material of the balloon (and that this is important).
It has to use that information to consider how it would affect people, and what their reactions would be both before and after it explodes/pops.
This is multi-step reasoning through an issue that involves pulling together common expectations, physics and how humans react.
Here's a statement in it that shows to me more than just pulling a few answers together
> Balloon Behavior: Instead of floating up like a helium-filled balloon, this balloon would drop to the ground because the gas inside is denser than air. This might surprise the attendees, and curious children might approach or pick up the balloon, further exposing themselves to radiation.
-
> The feelings of the scenario reads like any PR comment after a tragedy. "We feel shock and disbelief" and so on.
Those are typical things, which is not surprising, but it is also clearly linked with the question. You have to understand how out of context this would be.
> If the training data didn't include the words neutron or proton it would have no idea where to begin.
Fully rediscovering what took humans many years to do off-the-cuff is an outrageously high bar.
What features of a question would you look for to identify whether it's "taking several answers from a database and merging them together" or performing some reasoning? I've asked a few times but don't understand what you're expecting.
> What features of a question would you look for to identify whether it's "taking several answers from a database and merging them together" or performing some reasoning? I've asked a few times but don't understand what you're expecting.
You're misunderstanding me, I'm setting no bars, and I have no threshold where this changes. We humans are also just looking things up in our database and doing deductions. We do some computing on urgency as well, like how when we hear a bang our mind goes for danger first before realizing it was harmless, but very similar to what these AIs do. Probabilities and experience. Fresh and novel ideas are very rare in humans as well, and not something I demand before I would consider someone a human.
I did however give you an example that would surprise me, if it considered mass and environment in a way that proves that it understands the problem for what it is. If it told me weight is a human construct and requires gravity/movement and how it depends. An intelligent human doesn't necessarily answer the question it is asked in the way it is phrased. It identifies and irons out misunderstandings, assumptions and other details important to correctly understand the problem, and may even rephrase the question to give a proper response. That would show me a deep understanding of the problem and maybe freak me out a little, but only if the hallucinations are gone and those can be difficult to spot.
This is, just like us, performing calculations and database look-ups. It may feel like it's doing something else but it's not. What would happen if we leave the weights as they are but switch the words? It would give us complete gibberish, but it's no less correct than it was before and it's not even giving us different answers, only the translations to language get distorted. Most people would call it stupid and pointless even if the only change is our interpretation of the answers.
I'm sure Hiroshima, Fukushima and other dangers of radiation is in the training set, as are all of the other steps you mention, it goes round and round testing the numbers based on training. Remember how this chain started, you claimed:
> They're not just retrieving stored text like pulling the most relevant passage from a database. If they were they'd not be able to deal with things outside the training set.
To which I simply replied:
> It's not taking a single answer from a database no, it's taking several based on probability and merging them into what it thinks we're looking for.
I read you (correct me if I'm wrong) as giving this way to much agency. To change my mind that it's doing something unexpected I would ask for logs on the calculations it does, and be able to correlate that to the training set. I have to be able to falsify the conclusions I'm asked to make. I know some people claim we don't understand these algorithms but I assume that's just hyperbole and with the correct measures we could follow every step.
If there are things there which I can not trace I would be very impressed, and honestly a little afraid. They are not trained for every single task, but approximations based on similarities have proven to be very capable even when we think we're out of context (we're not, it doesn't understand context and doesn't care, but neither do most humans).
The further question I still find interesting though.
> I read you (correct me if I'm wrong) as giving this way to much agency. To change my mind that it's doing something unexpected I would ask for logs on the calculations it does, and be able to correlate that to the training set. I have to be able to falsify the conclusions I'm asked to make. I know some people claim we don't understand these algorithms but I assume that's just hyperbole and with the correct measures we could follow every step.
This one is tricky. We know exactly what they do. Interpreting that is very hard though, they've a big pile of mathematical operations with billions of magical constants and it... works. We can see exactly what they do but if I could see every synapse firing in your brain I'd still not be able to understand how it works in a useful manner. So we understand them obviously, but at another level we really don't.
> I'm sure Hiroshima, Fukushima and other dangers of radiation is in the training set, as are all of the other steps you mention, it goes round and round testing the numbers based on training.
Just to be clear here, there is no recursion other than when you add more text. There is not an algorithm saying "identify parts X, then look in database Y, now summarise...". They're trained essentially to just predict the next word given some text. There's some later training to make them more conversational. The capabilities you see are just a consequence of that.
Othello GPT is show just moves. It ends up building an internal model of a board.
> I did however give you an example that would surprise me, if it considered mass and environment in a way that proves that it understands the problem for what it is. If it told me weight is a human construct and requires gravity/movement and how it depends. An intelligent human doesn't necessarily answer the question it is asked in the way it is phrased. It identifies and irons out misunderstandings, assumptions and other details important to correctly understand the problem, and may even rephrase the question to give a proper response. That would show me a deep understanding of the problem and maybe freak me out a little, but only if the hallucinations are gone and those can be difficult to spot.
Let's try and investigate that then, that sounds interesting. I'm not sure I understand myself what you mean that weight is a human construct (it explains the difference between weight and effective weight in the answers to me off the bat, that's the only real difference). Perhaps this is too simple, the answer is quite straightforward.
> If it told me weight is a human construct and requires gravity/movement and how it depends
I asked "Which is the most, a pound of feathers or a pound of helium?" with largely just your statement as the system message and got
>The question seems to contain an intrinsic confusion. When we discuss weight, both a pound of feathers and a pound of helium would weigh the same - a pound. The difference, though, comes in their volume and density. A pound of helium would take up a lot more space than a pound of feathers considering the density of helium is lower than the density of feathers. If you were implying which would be more in terms of volume, then a pound of helium would be significantly more than a pound of feathers.
> However, I might be wrong if we take into account that helium, being a gas, is usually measured in terms of its volume at standard temperature and pressure, rather than by weight like solid or loose materials such as feathers. Also, the weight of a pound can vary slightly depending on where on Earth it is measured due to differences in gravity. However, these factors don't fundamentally change the answer to the question as it was posited.
Perhaps instead you could give me a short question and the kind of answer that would surprise you? I know this thread has gone on some time, but personally this is interesting to me. If you wanted to shift off from hn, feel free to drop me an email, I have a vested interest in understanding how people view LLMs.
Yeah but my bet is these numbers can all be traced to the training data, even when they show out-of-the-box thinking (like alpha go did with a move we didn't get at first). That it would be expensive and impractical doesn't mean we don't know what it does, and those claiming so are just trying to build hype. To those I have a few suggestions, build a simple visualization of the path it takes when it gives a surprising answer and it will make total sense.
It's not practical to count every star in the galaxy either but we don't claim we don't understand them and selling it as magic (as some do). We find ways to make approximations we're happy with.
> Just to be clear here, there is no recursion other than when you add more text. There is not an algorithm saying "identify parts X, then look in database Y, now summarise...". They're trained essentially to just predict the next word given some text. There's some later training to make them more conversational. The capabilities you see are just a consequence of that.
This is contradictory. They ARE predicting the next word (really number, words are just our translation), then the next, then the next when building the response. Always in the context of what it's building, that IS recursion. And regarding "parts X, database Y", parts X is the prompt, find the vectors closest to that prompt in database Y, now build your best response. So it is working like you claim it isn't, but there are more steps. It is actually very simple in terms of database queries, the "magic" lies in the training and quality of the data. Genius in simplicity really and I'm not very surprised how well it works.
To understand where I'm coming from I'm not sure we're even that intelligent and making conscious decisions as opposed to just reacting to stimuli. On a macro level we're very predictable and gullible and honestly disappointing. I'm trying very hard to keep my optimism and see our potential to be better but it's getting harder every year.
> Perhaps instead you could give me a short question and the kind of answer that would surprise you?
I'm not intelligent enough to come up with such a question and since I don't have access to the training data I can never verify that it's not just a discussion being reworded. An AI trained on a specific task starting to do a completely different task would be very cool and difficult to tell if sentient or not. That's why I instead focus on the mistakes that I spot, rather than when it feels more intelligent than myself. The pound of X vs Y is no longer a good question since they fixed it. I found that mistake here on HN, and it was obvious what it was trying to do.
They are not stupid, but they are not sentient with agency either. With my level of cynicism setting the bar at "as good as humans" is a very low one. I know animals that impress me more. I want them to replace us, that should be the goal for our species. The problem with that is humans, we're still going to want infinite growth. Just look at the discussions being focused around what the unemployed are going to do after AI, not how we should put it to work for us so we can retire at birth. Gotta keep the wheels spinning, earth will probably multiply sooner or later. If not we'll just terraform Mars, parasites that we are.
> I know this thread has gone on some time, but personally this is interesting to me. If you wanted to shift off from hn, feel free to drop me an email, I have a vested interest in understanding how people view LLMs.
I agree it's been interesting, but I don't know if I'm a good source for how people view things. My views are more often than not regarded as controversial and strange.
It is a bit like technobabble.
https://chat.openai.com/share/71224df4-5c6c-45f7-88fd-eec316...
It isn't that much different than human behaviors.
People tend to repeat stuff they have seen done by our parents, sibling, friends, medias. Listen to people smalltalking in the streets, repeating the same things all over again every day. The easy success of marketing, politicians, dictators. The power of marketing and success of consumption society. Racism, bigotry, religions, addictions. All these are easily explained because people barely think. They just respond to internal and external stimulus with recipes they have been taught to follow without giving a second thought.
If you think about it we've gone the other way. We're teaching/conditioning humans to think less and react more. This has only gotten worse the last few years and I don't see any shift coming soon. Humanity unfortunately seems just as simple as the algorithm, use the right inputs, in the right context and you can make most of us act just like you want.
We don't necessarily have to replicate the way the human brain works, but as long as the machine is capable of performing quasi-cognitive tasks, there will be immense value (and disruption) to society.
Disappointing for sure, if you're still waiting for a sentient robot, but they do something we thought was limited to humans back in the day: going to a bookstore, and having the owner tell you "hey, I know you enjoy mystery novels taking place in England, I might have something new for you".
Isn't this just semantics, and the expectations that go with them, really?
If the marketing language surrounding ML wasn't so hyperbolic and sci-fi-y ("artificial intelligence"? "neural network"? give me a break!) I think we all could agree that what we can achieve now is really interesting and impressive in its own right.
Even if these models aren't on a path to some kind of "thinking computer" as you envision it, their "parlor tricks" are doing things I would've relegated to the realm of sci-fi even a decade ago, much less 25 years ago.
Simple statistical models that aren't "AI" so much as just generic ML were and are quite useful: like recommendation and newsfeed engines ("the Algorithm" as we call it so often today). Love 'em or hate 'em, they can be quite good at predicting interest/engagement.
The resurgence in deep learning in the 2010s has shown us new magic tricks, but they're still just that: parlor tricks. At least they're more convincing tricks than what we had 40 years ago!
That's what ultimately depresses me about AI. It's still just a parlor trick. We haven't actually taught computers to think, to reason, to be innovative. Deep learning is definitely having its day, but I suppose this too will pass unless we can unlock certain ways to make AI reliable and responsible. Or... to just start understanding it in general.