News for hackers. Stuff that matters.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by dvt on Friday March 31, 2023 @02:23PM (#35391158)
> it turned it from a math dummy to a math genius overnight

Imo your post fundamentally misunderstands a few things, but mainly how Wolfram works. Wolfram can be seen as a "database" that stores a lot of human mathematical information (along with related algorithms). Wolfram does not make new math. A corollary here is that AGI needs to have the ability to create new math to be truly AGI. But unless fed something like, e.g. the Principia, I don't think we could ever get a stochastic LLM to ever derive 1+1=2 from first principles (unless specifically trained to do so).

Keep in mind that proving 1+1=2 from first principles isn't even new math (new math would be proving the Poincaré conjecture before Perelman did it, for example).

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by Sivart13 on Friday March 31, 2023 @02:30PM (#35391269)
If the litmus test for intelligence is the ability to “create new math” most people on earth wouldn’t be considered intelligent
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by dvt on Friday March 31, 2023 @02:34PM (#35391321)
> If the litmus test for intelligence

Moving goal posts around is unhelpful. I think my comment was pretty clear in the context of AGI and calling ChatGPT a "math genius."

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by og_kalu on Friday March 31, 2023 @02:42PM (#35391440)
The fact that people take agi to mean "can invent new math" is a goalpost shift on its own. That was not the original meaning (generally intelligent), that wasn't even the next moved goal (on par with human experts). I guess the next one counts (better than all human experts) but i'm sure we'll move that again too.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by akiselev on Friday March 31, 2023 @03:24PM (#35392115)
The problem was always underspecified. We don’t have a quantifiable metric for intelligence except IQ tests, benchmark datasets like those used to evaluate different LLMs, and other similarly myopic bullshit. “We’ll know it when we see it” becomes the default.

In reality, the goal posts aren’t being moved, we’re just finding out how much further we are from them than we thought. ChatGPT is a "stochastic parrot" that’s seems way “smarter” than anyone thought possible so we have to reevaluate what we consider evidence of intelligence, perhaps coming to terms with the fact that we aren’t that smart the most of the time.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by og_kalu on Friday March 31, 2023 @03:33PM (#35392269)
Sorry but nope. GPT-4 is plenty intelligent. I've begun to question the intelligence of anyone that reduces it to "stochastic parrot" because they're not even arguing against results but arbitrary lines drawn on sand.

The "We'll see it when it comes" line is just utterly wrong, If there's one thing experts seem to agree on is that not everyone will agree when current definition of agi does arrive.

The philosophical zombie is an excellent example of the extent of post shifting we're capable of. Even when a theoretical system that does every single thing right comes, we're looking for a way to discredit it. To put it below what we of course only have.

lots of researchers now aren't questioning GPT's general intelligence. That's how you end up with papers alluding to this technology with amusing names like General purpose technologies(from the jobs paper) or even funnier - General artificial intelligence (from the creativity paper).

You know what the original title of the microsoft paper was? "First contact with an agi system". and maybe it's just me but reading it, i got the sense they thought it too.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by vintermann on Friday March 31, 2023 @04:08PM (#35392838)
> The philosophical zombie is an excellent example of the extent of post shifting we're capable of.

I was with you until here. That has nothing to do with this. That argument is about separating intelligence from having a subjective experience, not moving goalposts for intelligence.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by og_kalu on Friday March 31, 2023 @04:47PM (#35393417)
It's a tangential relation but it's a relation. I don't think i would say it has nothing to do with it. Goal posts shifting in the field of machine learning isn't just about the posts for defining intelligence. It's broader and deeper than that.

I brought it up because i thought it fit the point i was driving at. Humans/people don't see subjective experience. I don't know that you're actually having some subjective experience. I'm working on what i see and results, same as you.

If you have two unknown equations but one condition - these 2 equations return the same output with the same input. well, then any mathematician would tell you the obvious - the 2 equations are equal or equivalent. it doesn't actually matter what they look like.

This is just an illustration. The point i'm driving at here is that true distinction shows in results. It's a concept that's pretty easy to understand. Yet turn to artificial intelligence and it just seems to break down. People making weird assertions all over the place not because they have been warranted in any empirical, qualitative or quantitative manner but because there seems to be this inability to engage with results...like we do with each other.

when i show the output that clearly demonstrates reasoning and understand, the arguments quickly shift to "it's not real understanding!" and it's honestly very bizarre. What kind of meaningful distinction can't show itself, can't be tested for ? If it does exist then it's not meaningful.

I think that the same reason people shift posts for intelligence is the same reason people fear the philosophical zombie.

idk maybe i'm rambling at this point but just my thoughts.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by YeGoblynQueenne on Friday March 31, 2023 @06:18PM (#35394464)
>> when i show the output that clearly demonstrates reasoning and understand, the arguments quickly shift to "it's not real understanding!" and it's honestly very bizarre. What kind of meaningful distinction can't show itself, can't be tested for? If it does exist then it's not meaningful.

I agree with you totally. Here's some output that clearly demonstrates reasoning and understanding:

  All men are mortal.
  Socrates is a man.
  Therefore, Socrates is mortal.
I just copy-pasted that from wikipedia. Copy/paste understands syllogisms!

Explain that!

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by og_kalu on Friday March 31, 2023 @07:58PM (#35395436)
Is this your argument? Really?

I'm Just surprised honestly. All of the straw man arguments, this is the best you can come up with?

Man do better. GPT-4 would have a better response than this.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by YeGoblynQueenne on Friday March 31, 2023 @08:32PM (#35395703)
I don't understand your derision. Where is the "straw man"? I showed you "output that clearly demonstrates reasoning and understand[ing]" exactly as you said. How do you explain it, if not by saying it understands, and it can reason?

Are you really just going to cop out and avoid engaging seriously with my question? How do you explain the output above except as reasoning and understanding?

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by og_kalu on Friday March 31, 2023 @09:23PM (#35396031)
If you don't see anything up with the nonsensical paragraph you typed then there isn't enough intelligence to continue this conversation. Maybe Ask GPT-4 for help. It has the patience I don't. Either way, this is the end for me. Believe whatever you want, it's none of my business really. Good day.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by YeGoblynQueenne on Saturday April 01, 2023 @06:25AM (#35399047)
If it's so easy to see what's up with what I wrote above, then it should be pretty easy to say what's up with it. You've already written 87 words to dismiss it, but not a single word to say why you dismiss it.

I think that's because you have no idea how to explain why something is, or isn't understanding, or reasoning.

In your comment above you accuse people of not being able to tell you clearly why GPT-4 is not reasoning or understanding, but you, yourself, can't even say clearly why copy/paste isn't. You have no clue how to do that. If you can't even say why something isn't reasoning, or understanding, then how can you say that something is? Do you even know what you're talking about, when you're talking about "reasoning" and "understanding"?

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by tanseydavid on Saturday April 01, 2023 @06:02PM (#35404565)
>> I don't understand your derision. Where is the "straw man"?

I find it very difficult to believe at this point that you are arguing in good faith.

Your COPY-PASTE example is nonsensical as already pointed out.

Do you also think that a printing press (or a rubber-stamp for that matter) demonstrates reasoning?

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by YeGoblynQueenne on Saturday April 01, 2023 @09:05PM (#35405988)
>> Your COPY-PASTE example is nonsensical as already pointed out.

But will you explain why it is nonsensical? Because that has not yet been pointed out.

Lest you forget, here is what the OP said that I replied to:

>> when i show the output that clearly demonstrates reasoning and understand, the arguments quickly shift to "it's not real understanding!" and it's honestly very bizarre.

I also showed "output" that "clearly demonstrates reasoning and understand[ing]". Why is that nonsensical?

Edit: although it won't be very helpful to discuss this if you're not the OP and don't make the same assumptions as they. But go ahead anyway.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by melagonster on Saturday April 01, 2023 @09:28AM (#35400160)
you belittle a person by call him worse than AI, again and again. it almost like you just want to belittle human being.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by istjohn on Saturday April 01, 2023 @01:57PM (#35402390)
Here's what GPT-4 would have written:

og_kalu, I understand the point you're trying to make regarding the potential intelligence of GPT-4 and the connection with the philosophical zombie, but I believe there are some important distinctions to consider.

First, it's important to recognize that the goalposts for artificial intelligence have indeed been shifting, and for good reason. As our understanding of intelligence grows, so does our ability to build systems that can mimic it. However, this doesn't necessarily mean that a given AI system, like GPT-4, has truly achieved general intelligence. Instead, it might simply be that our models are becoming more sophisticated and better at solving specific tasks.

The philosophical zombie argument, on the other hand, is concerned with subjective experience and consciousness, rather than intelligence. A philosophical zombie is a hypothetical being that is behaviorally and functionally identical to a human being, but lacks subjective experience. The debate around the philosophical zombie is more about the nature of consciousness and whether it can be separated from intelligence, rather than the intelligence itself.

Now, regarding your assertion that true distinction shows in results, it's true that GPT-4 and similar models have shown impressive capabilities. However, it's crucial not to confuse correlation with causation. Just because an AI system can generate outputs that seem to demonstrate reasoning and understanding, it doesn't necessarily mean that it possesses true understanding. It might simply have learned to generate outputs that are highly correlated with human-generated responses, without any actual understanding or reasoning taking place.

In summary, while it's true that AI systems like GPT-4 are becoming more advanced and able to generate seemingly intelligent responses, it's important to differentiate between the appearance of intelligence and genuine understanding. Furthermore, the philosophical zombie argument is primarily concerned with consciousness, not intelligence, so it may not be entirely relevant in this context.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by lukeschlather on Saturday April 01, 2023 @03:16PM (#35403161)
> The fact that people take agi to mean "can invent new math" is a goalpost shift on its own.

I don't think this is a goalpost shift at all. I agree that GPT actually is "generally intelligent" but then so is Google Search. The point of the term AGI is that it has generally applicable intelligence that is on par with a human, I don't think that's really changed.

The problem with GPT is still that every single interaction I've had with it, I've pointed out issues with its logic and it is incapable of understanding my objection. It agrees with whatever I say and then immediately repeats the same mistake. And these aren't "invent new math" questions, there's a very clear inability to follow a logical chain of cause and effect.

I should be clear at the same time I still have a feeling ChatGPT might be conscious. It's obviously kind of a dreamlike consciousness without ability to hold state but it does feel like it could be conscious.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by tanseydavid on Saturday April 01, 2023 @06:05PM (#35404598)
>> is that it has generally applicable intelligence that is on par with a human

Which human or humans?

I freely admit that I do not posses the intelligence to "invent new math" but I am pretty sure that I am "smarter than the average bear" (to borrow a phrase).

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by eternalban on Friday March 31, 2023 @02:45PM (#35391491)
Will you settle for whiz?

Interesting q for us to consider is how do we come up with "new ideas". I think we can consider play (in the abstract sense) to be a significant element of the process. Play is a pleasurable self-motivated activity.

I am certain an AGI (if such a thing exists) will need to be playful.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by dvt on Friday March 31, 2023 @02:49PM (#35391553)
Totally agree. Recently read Finite and Infinite Games[1] and The Grasshopper: Life, Games, and Utopia[2] and I'm more or less convinced motivations are always essentially games.

[1] https://www.amazon.com/Finite-Infinite-Games-James-Carse/dp/...

[2] https://www.amazon.com/Grasshopper-Third-Games-Life-Utopia/d...

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by eternalban on Friday March 31, 2023 @03:38PM (#35392346)
Thanks for book refs. Would you recommend any of them for a bright teen? [1] sounded like a good candidate.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by dvt on Friday March 31, 2023 @04:35PM (#35393266)
Yep, they're both super approachable, [1] is a great way to get introduced to some deep philosophy in a fun way.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by bathMarm0t on Friday March 31, 2023 @06:42PM (#35394757)
[1] is an exceptional book for a bright teen, especially so if you suspect the teen leans into their intelligence/abilities to gauge their self worth (I don't know a single person, let alone teen who doesn't do this). The book's main theme states that being a good player has nothing to do with skill, but rather with the ability to create playful environments that encourage growth, humility, and most importantly, more play.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by jadbox on Friday March 31, 2023 @02:38PM (#35391385)
This is a fair response, but in the author's defense, he might be trying to imply that intelligence is something that should be at least "capable" of creating new origin ideas and concepts. Of course, we can then debate what does it mean to be capable of original new ideas? (or what it means to be original)
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by chasd00 on Friday March 31, 2023 @02:49PM (#35391552)
that reminds me of this scene in irobot

spooner> You are a clever imitation of life... Can a robot write a symphony? Can a robot take a blank canvas and turn it into a masterpiece?

sonny> Can you?

edit: i just realized OpenAI can answer both of those questions with "yes." ...

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by Baeocystin on Friday March 31, 2023 @03:09PM (#35391876)
It's a fantastic scene. The childlike earnestness of Sonny asking completely deflates Spooner's rant.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by Workaccount2 on Friday March 31, 2023 @02:49PM (#35391549)
My definition of "mathematical genius" is simply wider than yours. To me its people who can solve math problems that 99.9% of the population can't without assistance. Which I think is a fair colloquial definition.

ChatGPT went from struggling to provide the answer for 20x20 to easily being able to provide the right answer for any math problem wolfram alpha can.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by dvt on Friday March 31, 2023 @02:57PM (#35391666)
> To me its people who can solve math problems that 99.9% of the population can't without assistance.

You're just kind of re-emphasizing my point: ChatGPT is using Wolfram as its assistance. So really, it's acting more like a "dumb" API call, not a "math genius" at all.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by Baeocystin on Friday March 31, 2023 @03:12PM (#35391943)
I mean, what is crystallized intelligence, but that which we can call upon without having to focus on it?

I mean this honestly, no snark. When I was a kid, learning how to factor numbers was really hard. It took a lot of time and concentration to do even basic problems, and people who could do it quickly without much perceived effort were a mystery to me.

By the time I reached high school, I had enough practice that I recognized the common patterns without difficulty, and often the answer bubbled up to my conscious mind without thinking about it at all. It sure feels like my brain is making an API call to a subsystem, you know?

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by sebzim4500 on Friday March 31, 2023 @04:45PM (#35393381)
He's not really saying that GPT-4 is a 'math genius', rather the combined system of GPT-4 and Wolfram is.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by dvt on Friday March 31, 2023 @08:24PM (#35395627)
But that doesn't really mean much. It's like saying I'm a "geography genius" while I have Google Earth open.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by atonse on Friday March 31, 2023 @09:19PM (#35395999)
And if you had Google earth hooked up to hidden headphones without us being able to tell, you would seem like a geography genius to us. that’s the point.

it seems like you’re arguing whether the genius label only has to be innate. But if you are able to effectively get help from sources, the effect can be the same.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by pixl97 on Friday March 31, 2023 @10:06PM (#35396309)
It's a question of latency...

It takes you, what, seconds to type digits into a calculator?

But if you embedded a calculator into your brain and could put in and pull values out of it in microseconds how are you different from a math genius?

Same with millisecond access to Google earth, at some point smarts+speed of access is a system within itself.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by dvt on Friday March 31, 2023 @10:51PM (#35396572)
> But if you embedded a calculator into your brain and could put in and pull values out of it in microseconds how are you different from a math genius?

Tao, Perelman, Wiles etc. aren't math geniuses because they can multiply numbers fast (which is a super weird definition of "math genius" tbh). They're math geniuses because they answer really hard questions in creative and unexpected ways; ways that often open up entire new areas of mathematics.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by aik on Saturday April 01, 2023 @12:10AM (#35397031)
I think you’re sidestepping the point here. The point is that the combo of these systems becomes one unit. One integrated system. That’s the new system to measure. Similarly, your prefrontal cortex without a hippocampus sucks. The combo of them (and other distinct parts of the brain that handle specific functions and have specific purposes that interact with other parts in a specific way) - that is what causes our specific type of intelligence to emerge. The brain as a whole is much more interesting and practical to measure.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by dvt on Saturday April 01, 2023 @01:07AM (#35397328)
Yeah this is a valid criticism of the Chinese Room (called the "Systems Counterargument")[1]. I think it's a weak-ish riposte in this context though, mainly because we have no real idea how our own brains work and how their parts causaly interact (other than handwavy "these neurons are firing in this area").

[1] https://iep.utm.edu/chinese-room-argument/#SH2a

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by aik on Saturday April 01, 2023 @07:26PM (#35405261)
I think the most likely case is that the properties of a system that leads to emergent behavior (part of complexity science) are very much present in the brain where the various components with a proper balance leads to the intelligence we have.

An interesting intelligence emerges from a colony of ants compared to one. An interesting intelligence emerges from the relations of the various parts of the brain. An interesting intelligence emerges from the combo of techniques that have led to GPT and other surprising AIs. Same with a human, to two humans collaborating, to tribes to companies to cities etc. And likely same by combining/integrating GPT-4 type of LLMs with other tools and with other specific purpose LLMs - a greater unit of significance will emerge. (The non-predictability of this with current science is what is kind of scary to me.)

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by tanseydavid on Saturday April 01, 2023 @06:14PM (#35404670)
>> Tao, Perelman, Wiles etc. aren't math geniuses because they can multiply numbers fast

You're getting stuck on semantics.

I expect Tao, Perelman, Wiles, etc. can process/handle/deal with numbers much more rapidly than I can.

Now imagine if these folks could do the same, except 10x or 100x or 1000x faster, without having to ever be bothered with things like sleep or food.

This may not be a good definition of a "Math Genius" but it is reasonable to think that all or most "Math Geniuses" possess this skill. Speed matters.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by Workaccount2 on Friday March 31, 2023 @05:20PM (#35393826)
It goes back to my original point, that I suspect AGI will come from an AI that is essentially a master of all APIs.

We can go back and forth splinting hairs about whether inserting a compute module into a neural net (organic or not) grants geniousness or assistance, but the overall point stands; there will be a single interface that can take any variety of inputs and properly parse and shape them, push them through the correct "APIs", and then take the results to form a clear and correct output. Whether or not it used it's neural net or transistor adders circuits to arrive at the answer would be immaterial.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by jules on Saturday April 01, 2023 @02:28AM (#35397718)
Wolfram Alpha is computation. So it became a computational genius in precisely the things that Wolfram Alpha can do. A better test is whether it can prove new lemmas, like the average undergraduate in mathematics. From what I tried, it cannot do that yet.

I'm convinced that doesn't require a breakthrough in the architecture or scale of LLMs, though. GPT-4 seems plenty smart enough to be able to learn that, if hooked up to a proof assistant like Lean or Coq with the right fine tuning iteration loop.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by CamelCaseName on Friday March 31, 2023 @03:26PM (#35392152)
Would AlphaZero or AlphaGo meet your requirements then?

They both created "new Chess / Go" strategies and insights that GMs and top engines hadn't seen before.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by dvngnt_ on Friday March 31, 2023 @06:32PM (#35394653)
it would meet mine. not sure is chatgpt does though
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by johnthewise on Saturday April 01, 2023 @06:32AM (#35399075)
You can combine those through apis to chatgpt to arrive at a system that does all that though.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by deepnet on Saturday April 01, 2023 @04:38AM (#35398482)
Add a expert human in the loop, e.g. Terence Tao and this might be feasible.