News for hackers. Stuff that matters.
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by p-e-w on Wednesday May 24, 2023 @01:26AM (#36054404)
> The gap between an LLM and a "human with below average intelligence" is far more than 10x.

In which direction?

GPT-4 passes the bar exam with a top 10% score. How do you think a human with below average intelligence (or even with average intelligence) would fare?

Copilot generates programming code that solves problems, and in most cases the code is correct. It outperforms many junior professional developers. Do you think a human with below average intelligence could do that?

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by intelVISA on Wednesday May 24, 2023 @01:44AM (#36054509)
> Copilot generates programming code that solves problems, and in most cases the code is correct. It outperforms many junior professional developers. Do you think a human with below average intelligence could do that?

Absolutely, it's why Javascript is so popular.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by p-e-w on Wednesday May 24, 2023 @01:56AM (#36054581)
A human with below average intelligence can outperform many junior professional software engineers because of JavaScript?

Do you mean a programmer with below average intelligence (for a programmer)? Because I'm having a hard time believing that you actually believe what you wrote.

BTW, JavaScript is actually a fairly difficult language to learn and use. Python, BASIC, and even Fortran are much simpler conceptually and have far fewer pitfalls. JavaScript is popular because it's the only language that every modern computer has an interpreter for, not because it's so easy that idiots can use it.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by arcanemachiner on Wednesday May 24, 2023 @02:10AM (#36054663)
It's gotta be a low-effort joke.
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by intelVISA on Wednesday May 24, 2023 @02:21AM (#36054745)
It was a bit tongue in cheek I'll confess. :)
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by nemothekid on Wednesday May 24, 2023 @02:18AM (#36054720)
>How do you think a human with below average intelligence (or even with average intelligence) would fare?

I don't understand what rote memorization to pass a test has to do with intelligence. For the record Kim Kardashian passed the bar; I imagine anyone given the proper motivation and time to study could do it, it's not a hard test.

If AGI is a computer passing a test, then AGI was achieved a long time ago. I don't think a human with below average intelligence could multiple 2 very large primes but I don't mistake my calculator for intelligence. A below average intelligence human can drive a car with a couple hours of training, an LLM can't do that (with a far lower power budget as well).

I'm not saying AGI is impossible, but it's clear LLMs are not AGIs; it's not a matter of having a 100x more powerful LLM, just like making an Ape better at sign language won't make them better at abstract reasoning. An Ape's brain fundamentally lacks the mental machinery for higher level things that humans do. It's not a question of not being smart enough. LLMs are simply one component of the human mind.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by p-e-w on Wednesday May 24, 2023 @02:30AM (#36054785)
> If AGI is a computer passing a test, then AGI was achieved a long time ago.

AIs couldn't even pass a third-grade reading comprehension exam until about 5 years ago. Computers being able to pass tests designed for humans is a very new thing.

> it's clear LLMs are not AGIs

And the main argument for that is that "it's clear". They're beating lawyers, doctors, and software engineers, but obviously, that's not real intelligence...

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by qup on Wednesday May 24, 2023 @02:41AM (#36054851)
> Computers being able to pass tests designed for humans is a very new thing.

Yes! Captchas so effective!

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by comex on Wednesday May 24, 2023 @03:50AM (#36055209)
Yes, it would be more accurate to say “computers being able to pass tests designed for humans by humans”, as opposed to CAPTCHAs which are automatically generated tests.
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by shreyshnaccount on Wednesday May 24, 2023 @02:48AM (#36054889)
You're assuming that everything needed to write code or make arguments is purely intelligence based and has nothing to do with patterns, structural repetition and things glorified autocomplete could do, and that's not true.
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by flangola7 on Wednesday May 24, 2023 @03:08AM (#36054972)
Who said anything about everything? AI could not write code AT ALL until very recently. We could invent a drug that kills 99% of cancers and the next day there would be people bemoaning that it isn't a "true" cure.
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by shreyshnaccount on Wednesday May 24, 2023 @03:54AM (#36055243)
Hey you're the one claiming intelligence and all, burden of proving it in squarely on you
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by dr_dshiv on Wednesday May 24, 2023 @04:31AM (#36055447)
Yes. Let’s define AGI as ability for a single model to pass most human professional tests (no cheating) and to provide genuine human-level flexible cognitive benefit to specialized professionals in diverse fields. Reasonable?
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by shreyshnaccount on Wednesday May 24, 2023 @08:34AM (#36057126)
No, because most tests designed for humans test memory and pattern recognition, which computers already can do better than humans so it's not a useful comparison. I'd rather define it to be superhuman AGI when it not only performs better on tests with humans who can use computers during the test but also can perform everyday tasks which are not 'hard' for us humans. That is because we have the hardware in our brains to do these things, doesn't mean that it's easy in the least for a computer.
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by dr_dshiv on Wednesday May 24, 2023 @08:47AM (#36057256)
Have some examples? What would be tests that, if passed, you’d say “oh yeah, that’s AGI.”

For instance, if it could make a peanut butter and jelly sandwich? Most challenging things that are easy for us are in the motor domain. While important, I think “intellectual AGI” is a meaningful milestone and closest to what most people think of when they think AGI.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by shreyshnaccount on Wednesday May 24, 2023 @12:13PM (#36060181)
The problem with defining AGI isn't only in defining intelligence, but also defining general. Also, why do we treat AGI as a yes/no question, when it probably makes sense to think partially... i don't have a definition of either
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by dr_dshiv on Wednesday May 24, 2023 @05:12PM (#36063912)
And that’s why I argue that AGI is already here. It is a spectrum. And we are well along the way to further acceleration. And if you want to say “no, we are not at AGI yet”, we need to define a clear test of what would be beyond that point.
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by nemothekid on Wednesday May 24, 2023 @10:12PM (#36066350)
>Have some examples? What would be tests that, if passed, you’d say “oh yeah, that’s AGI.”

The "G" in AGI is general. A computer program or system that could both, lets say write code and learn drive a car would be something closer to an AGI. Written tests are remarkably brittle in showing how intelligent someone is - like we already know the limitations of tests in the real world! Einstein famously flunked his entrance exam, but then invented general relativity at 26; but other posters would have you believe an LLM is more intelligent than Einstein because it could pass a test. When an LLM defends a dissertation in arguably any field that would be way more impressive than an LLM passing a test that humans already designed and know the answers to.

One problem I have with saying a 100x more powerful LLM could become AGI is that there is nothing that leads me to believe that LLMs, as they exist currently, are capable of synthesizing new knowledge and I'm not sure what breakthroughs you would need to get there. Once you start to think about that, you start to run up on the limitations of the LLM. If I were to invent a completely new programming language, I could probably teach a junior engineer how to use it in a week, but the jury is out if I would need to first generate 50,000 sample program and spend $1,000,000 in gpu compute to get an LLM to output the same thing. It's hard to consider such a system AGI. Further still, sure you have Google spending millions of FSD, but it's hard to consider the system they have as general. Could I take Waymo and have it pilot a forklift? Or a submarine? How much would that cost? A """below average intelligence""" human could learn to use a forklift in an afternoon.

All in all, there's more to intelligence than written tests.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by TimPC on Wednesday May 24, 2023 @11:52AM (#36059818)
This definition fails badly because it doesn't test anything outside of language. At a bear minimum have the tests involved have pictures and descriptions in them and require the AI to use the same model to synthesize information from both.
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by dr_dshiv on Wednesday May 24, 2023 @05:12PM (#36063921)
Lots of human tests involve pictures. Why does the definition fail badly?
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by flangola7 on Wednesday May 24, 2023 @05:40AM (#36055779)
Where have I claimed anything?
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by shreyshnaccount on Wednesday May 24, 2023 @08:35AM (#36057142)
I'm sorry if I misunderstood your comment but your tone seemed to imply that
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by pixl97 on Wednesday May 24, 2023 @11:46AM (#36059722)
"intelligence"

This is a very problematic word. For example if you were a civil engineer and went "throw me any old design for a bridge, I have a river I need to cross", you'd have your license removed.

Intelligence is too massively loaded, and too much of a gradient even across humans to try to some up human or AI abilities. It is a multitude of different capabilities that don't necessarily have to be bundled together for something to be 'smart', 'useful', 'capable', and/or 'dangerous'.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by WoodenChair on Wednesday May 24, 2023 @01:10PM (#36061142)
>> If AGI is a computer passing a test, then AGI was achieved a long time ago.

> AIs couldn't even pass a third-grade reading comprehension exam until about 5 years ago. Computers being able to pass tests designed for humans is a very new thing.

You're narrowly defining what a "test" is. And therefore the "until 5 years ago" doesn't make any sense. A test is not just written exams like a "third-grade reading comprehension exam." Is playing chess against the world champion not a test? A trad AI computer program beat him 25 years ago, not 5 years ago. Is diagnosing patients with a particular disease better than the average untrained human not a test? An expert system did that 50 years ago.

Your point is not a refutation of the parent post.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by ithkuil on Wednesday May 24, 2023 @02:45AM (#36054873)
> it's not a matter of having a 100x more powerful LLM,

I think we all can agree that even the best LLM currently is not AGI. That's not what being disputed here I think.

However a 100x more powerful LLM is not just 100x better at recall. A 100x more powerful LLM is not just 100x better at being stupid hallucinatory parrot. A model that is just 100x bigger is not necessarily 100x more powerful if you define power is the ability to achieve goals.

However pure language models will always lack something else: the ability to ground things in reality.

I recently had a dream where I solved some problems and when I woke up I realized that those solutions were bullshit, but I also realized the whole approach of my dreaming self was very similar to what a LLM would have done.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by flangola7 on Wednesday May 24, 2023 @03:11AM (#36055001)
Define grounding things in reality.

We only have our 5 senses to go off of. Meta has already put out one multimodal model incorporating multiple data types, openai is undoubtedly working on it too.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by ithkuil on Wednesday May 24, 2023 @03:15AM (#36055019)
Grounding in reality can be something as simple as what openai is experimenting with plugins or something much more integrated.

It's not a matter of which senses you have, but about being able to "continuously" use them.

The current LLMs are basically unfiltered raw thoughts that must be continuously refined. A similar thing happens in our brains and only a little bit of that is accessible to our consciousness

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by TeMPOraL on Wednesday May 24, 2023 @04:45AM (#36055530)
> The current LLMs are basically unfiltered raw thoughts that must be continuously refined. A similar thing happens in our brains and only a little bit of that is accessible to our consciousness

Exactly. But, AFAIK, it's also the part that does the bulk of actual thinking and decision-making for us. In that sense, LLMs may be closer to AGI than people expect, because they seem to be capturing the actual core of intelligence and reasoning - and the missing bits (like long-term memory and higher-level thought stream filter/censor) may be much easier to bolt on to them.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by pixl97 on Wednesday May 24, 2023 @11:56AM (#36059885)
This is why we typically see better performance out of GPT when plugins are bolted in an chain|tree of though with reflection.

The output of LLMs is kind of like our stream of consciousness, there's a lot of things I think, then discount after internally reflecting on the thought which the often leads to a more correct solution. Having an LLM 'think' like this natively would massively increase the necessary the amount of compute needed, hence the expense, so at least in any public products it's not being done at this time.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by TeMPOraL on Wednesday May 24, 2023 @08:13PM (#36065632)
Yup. I totally expect you'll be able to eke out significant performance boost if you chain up the LLMs, so that e.g. you feed the initial query to a first-stage GPT-4 several times (likely in parallel), feed those to some kind of filter models that pass or reject the output, looping until you have, say, 3 passing outputs, then feed that to a summarizer, etc. Maybe play with generating system prompts so that you have multiple entirely different takes on the same query, or stage it. Or, you know, have GPT-4 look at the query and propose a graph of subsequent invocations for you.

I wish I had time to play with it some more right now. The pace of progress in the field is giving me a serious case of FOMO.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by ben_w on Wednesday May 24, 2023 @11:32AM (#36059522)
We have a lot more than 5.

Balance, proprioception, hunger, …

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by dr_dshiv on Wednesday May 24, 2023 @04:55AM (#36055582)
> I think we all can agree that even the best LLM currently is not AGI.

Disagree, for the record. If I’d described the capabilities of contemporary AI to 100 AI scientists 5 years ago, I bet more than half would agree to call that AGI. Further, more than 90% would assume that these capabilities were decades and decades away.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by jiggawatts on Wednesday May 24, 2023 @06:19AM (#36056027)
“Oh those goalposts? We moved them over there because they were getting uncomfortably close.”
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by ChatGTP on Wednesday May 24, 2023 @07:07AM (#36056354)
Cool, so we're at AGI, we just need ASI, maybe something a bit smarter, and we can shut the fuck up about it and get back to blwing billions on real living creatures problems? ;)
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by nemothekid on Wednesday May 24, 2023 @10:17PM (#36066384)
>If I’d described the capabilities of contemporary AI to 100 AI scientists 5 years ago

This is hard to believe, the all you need is attention paper was 6 years ago, GPT1 is 5 years old and GPT3 is 3 years old. The current crop of LLMs wasn't something that happened overnight.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by dr_dshiv on Thursday May 25, 2023 @06:39AM (#36069045)
No one thought GPT1 would have these scaling effects. Really.
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by hawk_ on Wednesday May 24, 2023 @03:10AM (#36054983)
> For the record Kim Kardashian passed the bar;

While I know the wider point you're trying to make, Kim Kardashian is a very smart business person. She may just not fit your narrow definition of "intelligent".

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by Kiro on Wednesday May 24, 2023 @03:33AM (#36055125)
Are you saying that Kim Kardashian is stupid?
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by TeMPOraL on Wednesday May 24, 2023 @04:36AM (#36055478)
> it's not a matter of having a 100x more powerful LLM, just like making an Ape better at sign language won't make them better at abstract reasoning. An Ape's brain fundamentally lacks the mental machinery for higher level things that humans do. It's not a question of not being smart enough. LLMs are simply one component of the human mind.

I believe you do have a good point overall, but this here is, IMHO, a rather bad example, because I'd argue GPT-4 is already capable of abstract reasoning, and this seems to be exactly the skill that improves with increasing dimensionality of the latent space.

I agree that LLMs are equivalent of a single component of a human mind. Specifically, I think they're closest equivalent to our inner voice / inner thoughts. But this part is arguably exactly the one that does most of the abstract reasoning (and most reasoning in general), so I think in fact LLMs do have the "hardware" for that specific aspect. What's lacking right now is the equivalent of the higher, "conscious" layer, that guides, filters and censors the stream of thought. That, and long-term recall. Short-term memory might atually correspond to what the context window is in LLMs.

That, and fusing in all the other senses (sight, sound, smell, taste, touch, time, etc.).

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by chaxor on Wednesday May 24, 2023 @10:44AM (#36058846)
You definitely should not make claims like 'LLMs can't drive cars'. LLMs have already been shown several times to be able to navigate as agents in different world environments. Obviously, I'm not advocating this is a good idea, and certainly light years away from safe - but as an experiment in silico, I imagine it can be done quite easily (and probably already has).

The reason scientific researchers in this area are using the term 'AGI' so much is that it does fit the definition of AGI ... *For some definition of AGI*. And there lies the problem - no one can really come to a good consensus on a good definition of AGI. This is why many scientists in this area are avoiding the question altogether - the question is loaded, and is misinterpreted by the public if statements are made.

So, for example, if I make the statement here that e.g. GPT-4 has intelligence which is general (AGI), it will likely be met with a rabid response from HN. However, the claim may be more dull than you're expecting. People often conflate AGI with things that are not required, such as agency, etc.

This definition from [journal Intelligence Vol 24, No1, 1997] can be that "some definition" of AGI: must be able to 1) think abstractly, 2) comprehend complex ideas, 3) reason, 4) plan, 5) solve problems, 6) learn quickly from experience.

Many of these GPT-4 can do, if some modifiers are allowed - for example, GPT-4 can learn quickly from experience so long as you aren't starting a 'new' GPT-4 system from scratch every time you want to interact with it. This is probably preferable, since much of the experiences it will have are personal to the individual working with it, and it would be highly undesirable to do the opposite here. Planning was difficult for the system early on, but it has appeared to learn that it is helpful to lay out a plan early on in a large task, so that appears to be a capability as well, at least on a basic level qualitatively. There is some good literature on ability to reason (and solve problems in abstract and complex ideas) from Microsoft's group on causal reasoning. In pretty much all tasks of causal reasoning the system can achieve near human performance, and LLMs as a category outperform previous SoTA from more targeted or specific systems made for causal reasoning.

Anyway, I would suggest to anyone that has strong reactions to claims about AGI to realize that they are likely building up the statement to be more than it is. Perhaps similar to 'machine learning' may have been misinterpreted years ago ("A machine can learn?! There is no tomorrow!!"), what is being stated here is often more narrow than you may believe.

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by satellite2 on Wednesday May 24, 2023 @03:20AM (#36055054)
Maybe we are simply culturally inclined to believe that the bar exam is more sophisticated than say, learn how to drive. A lot of the compute power required to drive is simply hidden from us because it's inconsious. While intellectual tasks are mostly done consciously. So it remains to be shown which task is actually more complex. And in the meantime it's clear than most people, independantly of their academic background can learn how to drive relatively easily.
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by dontupvoteme on Wednesday May 24, 2023 @05:45AM (#36055805)
it's controversial but they're not allowed to sue us for it -- being a lawyer or doctor just requires a lot of rote memorization.
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by pmoriarty on Wednesday May 24, 2023 @06:08AM (#36055940)
"GPT-4 passes the bar exam with a top 10% score."

Turns out that may be as much marketing as truth.

According to this paper[1]:

"although GPT-4's UBE score nears the 90th percentile when examining approximate conversions from February administrations of the Illinois Bar Exam, these estimates are heavily skewed towards repeat test-takers who failed the July administration and score significantly lower than the general test-taking population. Second, data from a recent July administration of the same exam suggests GPT-4's overall UBE percentile was ~68th percentile, and ~48th percentile on essays. Third, examining official NCBE data and using several conservative statistical assumptions, GPT-4's performance against first-time test takers is estimated to be ~63rd percentile, including ~41st percentile on essays. Fourth, when examining only those who passed the exam (i.e. licensed or license-pending attorneys), GPT-4's performance is estimated to drop to ~48th percentile overall, and ~15th percentile on essays."

[1] - https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4441311

Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by TimPC on Wednesday May 24, 2023 @11:50AM (#36059776)
Sure but I can find examples of this in both directions. GPT-4 fails spectacularly at any task that doesn't have very precisely sanitized inputs presented to it in a certain format. It also fails at any task requiring any sort of interaction with the world. I think criticisms that it isn't a general intelligence are entirely fair even if it seems a bit more like general intelligence than most things that came before.
Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode... by gentleman11 on Wednesday May 24, 2023 @11:55AM (#36059867)
> GPT-4 passes the bar exam with a top 10% score

There was an article on HN yesterday debunking that. OpenAI is prone to exaggerating