News for hackers. Stuff that matters.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by catoc on Wednesday March 15, 2023 @03:32PM (#35173547)
GPT 1/2/3/4 is not AGI.

I don't understand the fixation on this concept that is so far removed from what is happening here.

Yes it's cool. Useful. Transformative likely. But AGI...!?

"Any sufficiently advanced technology indistinguishable from... AGI" ?

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by elforce002 on Wednesday March 15, 2023 @03:42PM (#35173659)
This. The hype is getting out of control. Bet money we'll have a bubble 1 or 2 years from now. It was the same with crypto bros, etc...

Heck, even zuck is steering away from vr and going all in with "AI".

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by samsolomon on Wednesday March 15, 2023 @03:50PM (#35173784)
It seems like there are a lot of practical uses for generative AI where that was never clear with crypto. It is very easy to imagine how this type of technology can be applied to everyday tasks. The same can't be said about crypto.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by mjr00 on Wednesday March 15, 2023 @04:47PM (#35174489)
While I do think GPT will be quite useful, it's revisionist history to say that people weren't talking about crypto or Blockchain being transformative during the peak of the hype cycle. Plenty of people talking about how blockchain was going to disrupt supply chain logistics, bank settlements and identity management.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by Kiro on Wednesday March 15, 2023 @04:54PM (#35174573)
The similarities stopped once GPT started providing actual real value right here, right now, while blockchain is still stuck in speculative talking.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by samsolomon on Wednesday March 15, 2023 @09:02PM (#35176858)
I think the difference is that most people have a difficult time imagining what disruption to supply chain logistics looks like. But thanks to ChatGPT and Midjouney it’s very clear what AI writing a poem or generating an image from a description looks like.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by raincole on Wednesday March 15, 2023 @04:08PM (#35174033)
Generative AI, just like search engines and all the recommendation system, will be a part of our daily life.

I think the next generation will have a hard time to imagine a world without generative AI. Just like while I was born before google, I've forgotton how to look for very specific info in a physical library.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by catoc on Wednesday March 15, 2023 @03:50PM (#35173789)
Indeed. 'Crypto' used to mean 'cryptography'. Now it apparently equates to 'NFT'... and zuck will likely soon re-rename his company to metai over all this hype.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by galaxytachyon on Wednesday March 15, 2023 @06:25PM (#35175571)
And Musk will make a new company called Hent AI for all of your art and recreation needs...

Will be a big hit in Japan.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by pixl97 on Wednesday March 15, 2023 @04:47PM (#35174492)
Uses I've had for crypto: 0

Uses I've had for GPT: Um, lots.

Like, "Hey GPT, dump out some code that does this.... no I'm getting this error with that code. Ok, your last version worked"

I consider a piece of software that provides me useful tools not hype. ChatGPT has provided me with not hype.

Also, if we somehow magically got AGI this week, we'd have a shitload of problems the "This isn't AGI" people have not thought of yet. I hope and pray we are not able to figure out AGI soon because it is simply going to be the most disruptive thing that has ever happened in human history.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by slowmovintarget on Wednesday March 15, 2023 @06:10PM (#35175427)
"It's life, Jim, but not as we know it."
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by sebzim4500 on Wednesday March 15, 2023 @03:41PM (#35173645)
I like how the term AGI was invented because people couldn't agree on what AI was and now no-one can agree on what AGI is.

I don't understand why anyone even bothers using the term given in any serious discussion you need to define it up front anyway.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by z3c0 on Wednesday March 15, 2023 @03:48PM (#35173751)
The distinction between AGI and Narrow AI has existed for almost 30 years.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by nomel on Wednesday March 15, 2023 @03:52PM (#35173813)
I think a requirement of AGI is a feedback loop to allow continuous execution and “consciousness”.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by wizofaus on Wednesday March 15, 2023 @04:22PM (#35174202)
Really? How would we even test for that?
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by nradov on Wednesday March 15, 2023 @03:56PM (#35173852)
AGI can pass a rigorous Turing test. By rigorous I mean conducted over at least several hours by a panel of expert evaluators drawn from a wide range of academic disciplines such as computer science, philosophy, psychology, law, history, physics, mathematics, biology, medicine, sociology, and communications. While such evaluations are necessarily subjective, if a panel of experts agrees that a computer system acts like an AGI then it would be tough for the rest of us to dispute.

GPT4 is far from being able to pass such a test, and I don't expect GPT99 to get there either. A fundamentally different approach will be needed.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by PartiallyTyped on Wednesday March 15, 2023 @04:05PM (#35173997)
> By rigorous I mean conducted over at least several hours by a panel of expert evaluators drawn from a wide range of academic disciplines such as computer science, philosophy, psychology, law, history, physics, mathematics, biology, medicine, sociology, and communications.

Passing such a test is not a property expected of the average human yet the average human is considered a general intelligence, therefore this is not a property of a general intelligence.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by misnome on Wednesday March 15, 2023 @04:09PM (#35174039)
What if that average human has unlimited time to access and cross reference the entire written internet?
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by PartiallyTyped on Wednesday March 15, 2023 @04:19PM (#35174180)
Humans have mental bounds as well. Having information is not sufficient to synthesize new information that follows logically from the premise, nor is it sufficient to help you understand everything. Even with hundreds of years time there are mental leaps that most of us can't make.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by nradov on Wednesday March 15, 2023 @04:10PM (#35174056)
Are you even familiar with the Turing test? Passing doesn't require the subject to demonstrate any particular level of knowledge or expertise. The subject only has to convince the evaluators that it is roughly as intelligent as an average human. Average humans are expected to pass such a Turing test.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by PartiallyTyped on Wednesday March 15, 2023 @04:17PM (#35174143)
Why should a panel exist in the first place if you are not testing knowledge?

Intelligence is independent of one's knowledge. Plenty of intelligent but uneducated people, and plenty of educated people - or even people with perfect recall - that are not particularly intelligent.

If you are testing intelligence you should be able to distill it to particular tests independent of domain expertise.

Any intelligent agent should be capable of in-context learning.

So how would you go about doing that?

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by nradov on Wednesday March 15, 2023 @06:40PM (#35175699)
The (notional) panel exists to evaluate intelligence, not test knowledge or educational achievement. While some basic level of general knowledge would be necessary to even start a test the main focus would be on ability to learn and reason, including metacognition.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by logifail on Wednesday March 15, 2023 @05:01PM (#35174654)
> Passing such a test is not a property expected of the average human [..]

I'm thinking of the rabbit hole that is the hurdle to get citizenship in a particular country. "Outsiders" have to apply, pay, take and pass the test. "Insiders" don't have to take the test, they pass by default. Even if they don't know the answers to the test.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by catoc on Wednesday March 15, 2023 @03:56PM (#35173854)
AGI clearly has a connotation of sentience and intent, of general intelligence - as opposed to a tool, however intricate. Read Nick Bostrom (yes I know, as a person he's cancelled, probably even rightly so, still scientifically relevant reference; and totally not a discussion I want to get into further here, pls)
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by antibasilisk on Wednesday March 15, 2023 @04:31PM (#35174312)
But LLMs have been proven to demonstrate intent, and sentience is a philosophical question that doesn't really make any meaningful difference outside of questions of morality.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by catoc on Wednesday March 15, 2023 @04:53PM (#35174566)
I would say that the strings that are output by LLMs may fluently describe intent and purpose, but that actual intent requires a self awareness that utterly absent.

Just like the constant annoying 'apologies' do not in any way signify the model actually feels sorry.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by pixl97 on Wednesday March 15, 2023 @05:26PM (#35174950)
>Just like the constant annoying 'apologies' do not in any way signify the model actually feels sorry.

So your average corporation?

>I would say that the strings that are output by LLMs may fluently describe intent and purpose, but that actual intent requires a self awareness that utterly absent

The only reason I only partially/somewhat agree with this is current LLMs have no learning feedback loop as a means of short term actions to long term improvement. The moment that changes I'll take your statement and throw it in the trash bin of history. LLMs output have no (at least self-)purpose because they are just text output. The moment that text output goes to tooling, that tooling performs actions, and those actions are fed back into training the model then purpose is given. The self awareness loop is complete.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by antibasilisk on Wednesday March 15, 2023 @09:33PM (#35177066)
I don't agree that intent requires self-awareness.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by logifail on Wednesday March 15, 2023 @04:56PM (#35174606)
> LLMs have been proven to demonstrate intent [..]

That's quite the claim. Can you provide references?

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by antibasilisk on Wednesday March 15, 2023 @09:31PM (#35177048)
There are earlier papers, but page 15 of the GPT-4 paper demonstrates this.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by bootsmann on Wednesday March 15, 2023 @04:57PM (#35174614)
>But LLMs have been proven to demonstrate intent

I'd like to see this proof. Everything we've seen so far is just the AI reproducing what humans do, which happens to be writing with intent.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by antibasilisk on Wednesday March 15, 2023 @09:32PM (#35177056)
The two are not meaningfully distinguishable on a materialistic level.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by rootusrootus on Wednesday March 15, 2023 @03:49PM (#35173765)
I keep seeing the same leap over and over. "We don't precisely know how the human brain works, and we don't exactly know how GPT works, but they both have things we call neurons and they both learn, so what's the difference between a human brain and GPT?"

Humans really do love to anthropomorphize everything.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by davidthewatson on Wednesday March 15, 2023 @04:00PM (#35173917)
Indeed. It's a page from the DSM-5 scientism playbook. The thing to keep in mind is that robots love to roboticize everything, including humans:

https://medium.com/@jannaq/the-robot-takeover-is-already-her...

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by cheeselip420 on Wednesday March 15, 2023 @03:52PM (#35173804)
So a "regular" AI is one trained to perform a specific task - like recognizing dogs in an image or handwriting recognition.

These LLMs are trained for one skill: given the previous N tokens, what's the next token. From this single skill, they can generalize to many many many many useful use-cases. Is that general enough?

Or do we need to wait for the goalposts to move again and then blow past that limit too? Stop arguing semantics and start building cool shit.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by wizofaus on Wednesday March 15, 2023 @04:19PM (#35174175)
I don't know about GPT-4 but it's very easy to find cases where v3 is incapable of the generalized sort of mathemathical and logic problem solving that humans manage fairly easily, and on that basis alone it didn't classify as an AGI for me. If that can be addressed purely via LLM-technology I'll be impressed (and pretty surprised).
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by z3c0 on Wednesday March 15, 2023 @04:38PM (#35174383)
* * *
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by pixl97 on Wednesday March 15, 2023 @04:56PM (#35174604)
And at the same time it's solving lots of problems that computers have never been able to solve in the past. I'm glad it's not AGI because we'd have much bigger problems, but for a 'language' model it does have interesting methods of rationality, and when put in a verbose mode it seems to do much better. I've not had time to play around and get the interface to see if it can self correct statements it makes like this on first shot.

Me: Hello, I am asking you a logic question. Please explain what "it" is in the following sentence

Me: "The X doesn't fit in the Y because it is too small"

G4: In the sentence "The X doesn't fit in the Y because it is too small," the pronoun "it" refers to "X." The sentence is stating that "X" cannot fit inside "Y" due to its size being too small.

Me: "This is incorrect, please give step by step logic on why you came to this conclusion"

G4: Apologies for the confusion. I will provide a step-by-step logic for my interpretation:

The sentence is: "The X doesn't fit in the Y because it is too small." We need to identify what "it" refers to in the sentence. There are two nouns in the sentence: X and Y. The sentence structure is such that the reason for X not fitting in Y is provided after the word "because." The sentence states that something is "too small," which is the reason for the lack of fit. Since the reason for the lack of fit is being given, we can infer that the pronoun "it" should be referring to one of the two nouns. However, upon closer examination, my previous interpretation was incorrect. Revisiting the analysis, the correct interpretation should be as follows:

In the sentence "The X doesn't fit in the Y because it is too small," the pronoun "it" actually refers to "Y." The sentence is stating that "X" cannot fit inside "Y" because "Y" is too small to accommodate "X."

My initial interpretation was wrong because I didn't consider that "it" could refer to "Y" and that the sentence is explaining why "X" cannot fit in "Y."

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by misnome on Wednesday March 15, 2023 @04:06PM (#35174013)
Goalpost moving? Since when was this the goalpost of… AGI.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by lordfrito on Wednesday March 15, 2023 @04:29PM (#35174297)
I think it's more about the goalposts "coming into view more clearly" as we get closer to what we thought AGI was going to be.

There's no question that ChatGPT could pass the Turing test (assuming it's told to try and to not to say it's a computer).

So, from one standpoint we've made it. But I'm in the camp that says this really isn't the AGI I thought we were going to get. Semantics matter now, and we need better definitions of what we're trying to do now.

I believe an important part of the AGI problem has been solved (or is at least downhill from here). What to do about the other parts? Let's better define what we do and don't have.

That and come up with better tests to replace the now outdated Turing test.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by cheeselip420 on Wednesday March 15, 2023 @04:56PM (#35174597)
Yeah this is a valuable point - AGI just isn't specific enough.

ChatGPT is, an artificial generalized intelligence. But is that a useful label?

I imagine we'll be needing to find a way to better define and quantify intelligence (which has been a vexing issue for a long time)

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by og_kalu on Wednesday March 15, 2023 @05:12PM (#35174790)
No it's definitely moving. Somehow general intelligence has morphed into essentially super intelligence where the AI is expected to outperform every human expert at every task before people will call it AGI. Which is just ridiculous. The bar for AGI has been set so high by some that a significant percentage of the human population would fail. That's when you know things are out of hand.

This isn't the only erroneous bar either. Somehow, the synonymity to human intelligence is taking very weird importance. We have people inventing their imaginary/magical definitions of reasoning and understanding (that they can't test for) just so LLMs won't qualify.

GPT-4 is absolutely a general intelligence.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by pixl97 on Wednesday March 15, 2023 @05:21PM (#35174891)
"this really isn't the AGI I thought we were going to get"

This is the only possible outcome. Or at least from my interpretation is that science fiction has jaded us with the thinking that AI will be anything like a person at all. The human mind is a particular set of filters controlled by our wetware input devices and a somewhat narrow survivability window. The software we're building has a completely different set of 'mind' conditions so it's a mathematical certainty we're going to build mind that works very different from ours.

As you say we need better sets of definitions on what general intelligence even means. For example, what are the limits of human intelligence to ensure we're not missing broad categories of potential intelligence when testing AIs.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by catoc on Wednesday March 15, 2023 @04:00PM (#35173919)
It's not semantics, but building cool shit I like :-)
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by og_kalu on Wednesday March 15, 2023 @04:07PM (#35174023)
Yup. LLMs are obviously general intelligences. AGI is just a loaded term with posts constantly shifting.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by PartiallyTyped on Wednesday March 15, 2023 @04:03PM (#35173959)
Why is it not an AGI?

I keep seeing naysayers complain that it is not, but nobody actually articulates exactly what makes it a non-AGI in a manner that is sufficiently robust to argumentation.

I am willing to play the GPT's advocate and have this argument here provided that I do not get rate limited.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by wizofaus on Wednesday March 15, 2023 @04:28PM (#35174282)
I've posted a number of times why I don't think current GPT tech classifies as AGI and certainly not human-like intelligence, as have others. Ask it to solve novel mathematical and logic problems, for a start (even ones you'd expect high school kids to manage), or simple word puzzles (anagrams and the like - again, avoiding "known" examples that it's likely to have come across in its training data). Further, an AGI should logically attempt to "improve" its understanding of the world during a conversation, yet chat GPT never initiates a topic or asks you anything at all (even to clarify what you mean). It also repeatedly reminds you that it is only a language model.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by antibasilisk on Wednesday March 15, 2023 @04:33PM (#35174334)
Machines can never obtain human like intelligence because they are foundationally not human like, that doesn't mean they lack intelligence. That's like saying dolphins lack intelligence.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by wizofaus on Wednesday March 15, 2023 @04:53PM (#35174555)
I wouldn't claim ChatGPT lacks intelligence though. Clearly in terms of language comprehension and generation it does so.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by z3c0 on Wednesday March 15, 2023 @04:56PM (#35174594)
False equivalence. Dolphins have exhibited general problem-solving skills in a myriad of situations, and thus qualify as a general intelligence.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by wizofaus on Wednesday March 15, 2023 @05:16PM (#35174830)
Indeed, I had started to write something similar. And pretty clearly animals like Dolphins or Chimps when they exercise their general intelligence don't do it by manipulation of language tokens.

BTW I tried to get Chat-GPT to solve a problem chimpanzees have been observed being able to solve (using an inverted bowl to stand on in order to reach some bananas):

"I'm sorry, but it is not biologically plausible for a chimpanzee to use a bowl of water to access bananas on a tree"

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by dave84 on Wednesday March 15, 2023 @07:30PM (#35176125)
GPT-4 had no issues answering this.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by wizofaus on Thursday March 16, 2023 @02:18PM (#35186013)
Presumably because it's similar enough to descriptions of problems and how they were solved that are in its training data.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by antibasilisk on Wednesday March 15, 2023 @09:34PM (#35177068)
As has PaLM-E
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by pixl97 on Wednesday March 15, 2023 @05:37PM (#35175066)
I believe you're correct, but for possibly the wrong reasons. I believe that AI will be able to simulate a lot (if not most) humanlike action in the near future. The particular problem here is they will also simulate far more non-humanlike intelligence making the alignment issue an even larger problem than it already is.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by ekleraki on Wednesday March 15, 2023 @05:18PM (#35174866)
> Ask it to solve novel mathematical and logic problems

How exactly do you define novel tasks and problems?

My brother has had it do his programming homework (he's a teenager), written in Greek mind you and therefore novel task to the first-degree, and it succeeded. Thus it solved a logic task [1].

I have had ChatGPT parse math I had written in LaTeX and reach a correct result, do modifications and so on.

> Further, an AGI should logically attempt to "improve" its understanding of the world during a conversation, yet chat GPT never initiates a topic or asks you anything at all (even to clarify what you mean). It also repeatedly reminds you that it is only a language model.

Anecdata: I asked Bing (GPT4) to answer a few stuff and it asked for clarification twice in a row. The fact that it repeatedly clarifies its prompt is not a limitation of the underlying model as much as it is a limitation of the interface that injects a prompt. Dan and all the other jailbreaks out there bypass that.

[1] https://en.wikipedia.org/wiki/Curry%E2%80%93Howard_correspon...

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by UncleEntity on Wednesday March 15, 2023 @06:39PM (#35175696)
> I have had ChatGPT parse math I had written in LaTeX and reach a correct result, do modifications and so on.

Interesting, didn’t know it could do that.

Wondering if it could also follow along with the lemmas in various papers and reach reasonable conclusions.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by PartiallyTyped on Thursday March 16, 2023 @05:28AM (#35179829)
It depends, I have used Copilot to modify LaTeX and write segments of my thesis, and it works surprisingly well, though its arguments are not very precise.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by wizofaus on Thursday March 16, 2023 @06:35PM (#35189839)
https://medium.com/illumination/i-put-chatgpt-to-the-test-he... has some examples of simple maths/logic problems it can't really solve. It'd be good to know how much better chatgpt-4 is at them.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by Karunamon on Wednesday March 15, 2023 @04:41PM (#35174419)
* * *
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by PartiallyTyped on Wednesday March 15, 2023 @05:05PM (#35174712)
> One major reason it doesn't qualify is that it is impossible for it to learn from its input. It's right there in the name: generative pre-trained transformer

Both chatGPT and GPT models exhibit in-context learning, just as you do. The difference is that during your context updates modifications to your synapses occur as a consequence of your brain's activations.

Let's entertain a hypothetical scenario where I am a 5D creature, and you are (3 Space + 1 Time)D human.

I could go back to any point in your time and have any conversation that I wish with you. Each time I do that, I am effectively resetting your brain's state to that particular point in time.

The analog here is that for ChatGPT and the likes, time does not exist in the manner that it does for us, they are purely abstract in that they don't even need physical form to exist, it's a collection of ones and zeros that we store in such form because it is convenient.

You can very well store the parameters of the GPT models in any other medium capable of holding information and actually execute the model.

You can even compute gradient updates, or hook the models up to external data sources.

In the same vein, you "could" do the same for any human brain no matter how computationally prohibitive it may be.

You'd still classify the human brain as a general intelligence. Furthermore, we classify humans with long-term amnesia or inability to form new memories generally intelligent even though they only exhibit in-context learning.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by Karunamon on Wednesday March 15, 2023 @05:29PM (#35174985)
Interesting analogy… Actually a damn good one because I'm having a hard time finding how it leaks :)

I have to ask what definition(s) of intelligence we are using here. There are multiple, and GPT satisfies some to some degree but not others. Emotion and self-awareness can probably be written off entirely. Some experimenting shows that it still sucks at logic when presented with a pristine problem (something that definitely is not in its training set); and I would say this is a requirement of a general intelligence, being able to take the knowledge it has and speculatively applying that to things it has no knowledge of using induction/deduction.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by PartiallyTyped on Thursday March 16, 2023 @05:48AM (#35179947)
As I have said in a parallel chain, ChatGPT has been able to solve programming assignments for 15-17 year olds written in Greek. The P it has seen those tasks in Greek before is approaching zero imho.

> being able to take the knowledge it has and speculatively applying that to things it has no knowledge of using induction/deduction.

One could argue that its 'confidence' is an example of speculatively applying what it knows. The problem is that the inference machinery behind it is quite weak.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by catoc on Wednesday March 15, 2023 @04:11PM (#35174077)
Not trying to be a naysayer or downplay how cool GPT4 is, but the term 'AGI' has existed for decades and is suffering from general confusion and inflation (again like 'crypto' now being read as 'coins' or even 'NFT' by the general public).

See eg: https://en.wikipedia.org/wiki/Artificial_general_intelligenc... or better read Bostrom's book "Super Intelligence"

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by jstx1 on Wednesday March 15, 2023 @04:18PM (#35174158)
All the debate or whether it's AGI seems really pointless because the outcome doesn't change anything. Agree that it's AGI, don't agree -- either way the model is the same amount of good/useful/dangerous/ etc.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by 01100011 on Wednesday March 15, 2023 @04:28PM (#35174283)
100%

But we also shouldn't forget that things that are definitely not AI can be extremely disruptive and groundbreaking.

People are worried that AGI will rise up and kill us, but the definitely-not-AGI we have now is already sufficient to, say, create a drone army capable of killing based on arbitrary characteristics like race or skin color, or to demoralize us with disinformation campaigns.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by catoc on Wednesday March 15, 2023 @04:43PM (#35174435)
Disruptive, absolutely possible.

Releasing a killer drone army... absolutely not... the required intent is absent.

Being abused as a tool by sentient humans to demoralize others (or maybe even to release a drone army - if sufficiently interfaced) sure.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by kenjackson on Wednesday March 15, 2023 @04:39PM (#35174395)
Any sufficiently advanced tech is not indistinguishable from AGI. The original term, magic, really is more appropriate. The ability to factor any number quickly doesn't look like AGI, but can seem like magic.

And AGI is also not "mimics how the brain works". The original Turing Test was good because it really sat at the heart of the issue. Does the computer behave like a human during an interaction? At the end of the day we know very little about what makes us human (from a behviorial perspective), but we know it when we see it.

The question of AGI was never really an issue until ChatGPT. Asking an AI a question like, "Was Steve Jobs more or less effective as a manager than Bill Gates, just from a people manager perspective?" was moot as we had no technology that could really even parse that question, much less put together a coherent answer. Now our main gripe is that the AI answer to this question is more verbose and provides more context than what most humans would give.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by throwway120385 on Wednesday March 15, 2023 @04:44PM (#35174455)
The real problem is also that we have no way of knowing whether the ChatGPT answer is based on factual information. It is very skilled at inventing convincing facts from whole cloth.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by kenjackson on Wednesday March 15, 2023 @04:50PM (#35174532)
That is a problem with ChatGPT, but it has nothing to do with it being AGI or not. Politicians do this so regularly that we have websites like FactCheck. The question is can you tell that this is a computer making these facts up or do you think it is a human making up the facts.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by slowmovintarget on Wednesday March 15, 2023 @06:09PM (#35175418)
Politicians, generally speaking, know when they're making things up. ChatGPT and LLMs in general have no state evaluation on the text they've produced indicating its proximity to the truth.

This has everything to do with ChatGPT not being AGI.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by kenjackson on Wednesday March 15, 2023 @06:21PM (#35175525)
You are purely speculating about what a politician knows. I honestly don't even know what I know about me. I have some thoughts, but I'm not sure if those are just side effects of me processing or trying to maximize some function in my brain.

By your definition -- maybe we don't have (A)GI either.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by skdotdan on Wednesday March 15, 2023 @04:42PM (#35174427)
No one said it was. What some researchers hypothesize is that at the current rate of improvement, it wouldn't be especially unreasonable to expect AGI at GPT-N.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by baq on Wednesday March 15, 2023 @04:48PM (#35174496)
What is AGI?

If an AGI is something that can create and deploy an improved version of itself, then if exponential rate of improvement is preserved, we’ll see it in this decade.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by hackerlight on Wednesday March 15, 2023 @05:07PM (#35174725)
> GPT 1/2/3/4 is not AGI.

While true, that's the wrong lesson. The right lesson is GPT 1/2/3/4 are progressively getting closer and closer to AGI. You can't blame us for extrapolating only a few years into the future and planning for it.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by catoc on Wednesday March 15, 2023 @05:16PM (#35174832)
That is quite a claim. Would be cool if true. Do you have any references to back this up? Why would scaling up turn a model that strings tokens together into something that can reason by itself, unprompted, with intent?
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by pixl97 on Wednesday March 15, 2023 @05:32PM (#35175022)
Why is this whole 'unprompted' even important? A huge portion of human intelligence comes from external prompting (just research how very screwed up infants of exceptional neglect are). A model, or a human is going to need input/output from the external world. We're just arguing the semantics of the IO device at this point.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by hackerlight on Wednesday March 15, 2023 @05:37PM (#35175069)
> Do you have any references to back this up?

The reference is the GPT-4 release paper. It's getting progressively better at things that require intelligence, like writing code and doing unseen exams across various fields that humans find difficult. The generality and depth of intelligence is progressively improving.

> unprompted, with intent

Neither of these are necessary for AGI. Intelligence doesn't require intent. Intelligence doesn't require something to be "unprompted" (which human intelligence isn't, either, our brain is being constantly prompted by our external senses).