News for hackers. Stuff that matters.
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by roflyear on Friday March 31, 2023 @02:43PM (#35391443)
I am getting super tired of these responses.

Yes, I have tried it. Please converse in good faith.

GPT-4 has never, not once, in dozens of hours of use, asked me a clarifying question.

It cannot understand things.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by Game_Ender on Friday March 31, 2023 @03:42PM (#35392383)
One user said they got it ask for help by having a prompt asking it to ask some, but not too many clarifying questions.

With the instruction tuning it feels like model really wants to single shot respond vs. do a back and forth. So like a junior engineer who does ask for help you have to give it a hand.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by neilellis on Friday March 31, 2023 @04:20PM (#35393020)
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by Dzugaru on Friday March 31, 2023 @04:35PM (#35393249)
It definitely can "understand" things is some way, however I'm pretty sure ReAct or similar will give it just a nudge forward and the underlying problem of it hallucinating and not being "lucid enough" is not so easily solved.

In the original ReAct paper it falls apart almost immediately in ALFWorld (this is a classical test for AI systems - to be able to reason logically - and it still isn't generally solvable due to combinatorial explosion).

For now it requires human correction looped or not, or else it "diverges" (I like Yann Lecun explanation [0]).

In my own experiments (I haven't played with LangChain or ReAct yet) it diverges irrecoverably pretty quickly. I was trying to explain to it the elementary combinators theory, in the style of Raymond Smullyan and his birds [1] and it can't even prove the first theorem (despite being familiar with the book). A human can prove it knowing almost nothing about math whatsoever, maybe it will take a couple of days thinking, but the correct proof is not that hard - just two steps.

[0] https://www.linkedin.com/posts/yann-lecun_i-have-claimed-tha...

[1] https://en.wikipedia.org/wiki/To_Mock_a_Mockingbird

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by swid on Friday March 31, 2023 @11:52PM (#35396935)
The exponential divergence formula is true but says less than you think - the same math would be true for human output; we are likely to find a few falsehoods in any non fiction book for the same reason, right?
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by Dzugaru on Saturday April 01, 2023 @05:50AM (#35398857)
Yeah I'm aware of the criticism of that tweet, it may not completely make sense mathematically, but I just liked it because it's how I feel about GPT4.

It "diverges" while my human mind seemingly is different in some way - I can keep going at the math problem forever (for much longer?) and I won't hallucinate incorrect proofs (at least very unlikely, and I can keep re-checking them).

Of course this all in the area of feelings and faith - we just don't know much about cognition I guess.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by macrolime on Saturday April 01, 2023 @10:40AM (#35400636)
It performs much better when you add reflection to ReAct.

https://arxiv.org/pdf/2303.11366.pdf

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by roflyear on Friday March 31, 2023 @06:47PM (#35394796)
I don't think that qualifies? Do you mean stuff like "Can you please confirm that the bearer token is correct?" ?
Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by marshray on Friday March 31, 2023 @09:34PM (#35396117)
Friend, kindly be assured that I am indeed conversing with you in good faith. :-)

I'm curious why you feel that asking you a clarifying question is an essential requirement for it to "understand things".

I have not gotten it to issue a question mark '?'. But it did suggest to me an option:

    If you would like to define M(7) as equal to M(6), you can do so.
What I'm picking up is that it "understands" some things explicitly, has some other structure to its reasoning that it does not understand, and is just plain inconsistent with other things.

Not all that different from people TBH.

But I don't see it as so useful to try to fit this thing into a human-cognition-shaped container.

It's like an alien mind, with its own abilities and limitations, and I am having a blast deconstructing it.

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by roflyear on Sunday April 02, 2023 @11:31AM (#35411586)
> I'm curious why you feel that asking you a clarifying question is an essential requirement for it to "understand things".

It isn't a requirement, it's an example I used. You can come up with others, I'm sure! Like ask it to replace a word with another word. It kind of works! But also does random other things. Why? Because that's how these models function! But I asked GPT why these models often don't ask clarifying questions (try it yourself, new prompt! GPT-4!):

> I have found often that GPT models will just reply with answers, rather than ask clarifying questions about the text we're giving them. Why do these models do this?

The reason why GPT models may not ask clarifying questions about the text given to them is that they are trained to generate text based on the patterns and relationships they observe in large amounts of data. This means that they do not have a deep understanding of the content they are processing and are unable to determine whether or not they need additional information to better understand a particular text.

Additionally, GPT models are trained to optimize for the likelihood of generating coherent and grammatically correct text. In most cases, generating a response that directly answers the question or prompt given to them is a more effective way to achieve this goal than asking clarifying questions that may require additional context or information.

However, there are some techniques that can be used to encourage GPT models to ask clarifying questions. One approach is to include explicit cues or markers in the input text that signal to the model that additional information is needed. Another approach is to use training data that includes examples of the model asking clarifying questions, which can help the model learn to do so more consistently.

---

It's very convenient for all of us to think that GPT is like a human, but somehow not like a human enough to cause any moral issues!

It's like winning, but you don't even have to play!

Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends... by SanderNL on Saturday April 01, 2023 @04:54AM (#35398559)
It is writing a book. You need to set the stage properly so “asking questions” will become part of its story. Roleplay. It is not a being, there is no feedback loop, no motivation. If it is said to want something I think you can say it wants to finish the text. Whatever it is.