The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by travisjungroth on Monday April 10, 2023 @02:59AM (#35509835)

This is just silly. You’re saying that these models are completely incapable of what they’re doing and are only getting to answers from cheating. You can see this isn’t true very quickly when using them.

[Me] I want to make a bouquet to honor the home country of the first person to isolate Molybdenum. Be brief.

[ChatGPT-4] To honor Peter Jacob Hjelm, the Swedish chemist who first isolated Molybdenum in 1781, create a bouquet using blue and yellow flowers, representing the colors of the Swedish flag. Some suggestions are blue irises, yellow tulips, and blue delphiniums, arranged with green foliage for contrast.

I didn’t know the answer to that before asking. I also checked that it’s right. Soemtimes it’s right, sometimes it’s wrong. But if I walk up to a horse and ask it to stamp eight times, that’s going to happen approximately never. If I get it stamping at all, then maybe 1/20. This is much better than that.

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by EugeneOZ on Monday April 10, 2023 @04:10AM (#35510198)

Because you are using results of the training.

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by mandmandam on Monday April 10, 2023 @06:56AM (#35510970)

What human wasn't trained?

Even a child raised by wolves gets training.

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by EugeneOZ on Monday April 10, 2023 @09:52AM (#35512292)

LLM doesn't pick some results because LLM is smart, it picks results because it's trained. So analogy with a horse is valid.

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by kazinator on Monday April 10, 2023 @10:17AM (#35512600)

Writing programs requires an education. You can sort of fake it with training, if you're a machine that can train on a billion examples and reliably retain something from each one, without understanding any of them.

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by fl7305 on Tuesday April 11, 2023 @03:12AM (#35521842)

So your claim is that GPT-4 is a stochastic parrot?

Meanwhile, the creators at OpenAI claims that it is not.

How do we test your claim? What are the logical reasoning questions we can ask GPT-4 that it shouldn't be able to answer if it's just a stochastic parrot?

I keep asking people this, but so far no one has answered. Is the claim a personal belief that you don't want to discuss, similar to your religious beliefs?

If so, fine, but please make it clear that you're not making a scientific claim.

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by kazinator on Thursday April 13, 2023 @03:35PM (#35560990)

* * *

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by travisjungroth on Monday April 10, 2023 @12:33PM (#35514181)

You don’t get the horse analogy. The horse isn’t trained to count to eight. The horse is trained to stomp continuously. The performer yells “stop” at eight. It’s a carnival trick and a form of cherry-picking. The commenter was saying that ChatGPT doesn’t have the ability to solve these problems at all and people are just choosing the randomly correct answers. I think this is obviously not true.

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by kazinator on Monday April 10, 2023 @04:54PM (#35517274)

The purpose of the horse analogy wasn't so much to equate ChatGPT to a horse that just stomps, but the behavior of the humans around it who believe that it can count. This can be the naive trainer too, who doesn't recognize that he's subconsciously cuing the horse. He has a confirmation bias whereby he or she rejects any evidence refuting the hypothesis that the horse cannot count.

There is a difference between solving and problem and presenting a solution, and that difference doesn't hinge on whether the solution is correct.

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by travisjungroth on Monday April 10, 2023 @07:12PM (#35518540)

ChatGPT is making me realize how completely differently I see the concepts of knowledge and ability from so many people.

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by kazinator on Monday April 10, 2023 @10:15AM (#35512566)

A human isn't trained to program in Python by memorizing impressions of millions of examples correlated to a verbal description, from which he or she regurgitates mash-up that statistically correlates to the prompt, without having any idea what the content means.

Ask it to write the same program in some little known programming language. A human who knows how to code could do that by studying a small amount of reference material.

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by pmoriarty on Monday April 10, 2023 @10:48AM (#35512986)

"Ask it to write the same program in some little known programming language. A human who knows how to code could do that by studying a small amount of reference material."

That depends on the language, the human, and their state of mind.

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by travisjungroth on Monday April 10, 2023 @12:44PM (#35514279)

GPT-4 can do that.

[ Parent | on HN ]