News for hackers. Stuff that matters.
Re:A New Chat Bot Is a ‘Code Red’ for Google’s Search Business by incompatible on Saturday December 24, 2022 @06:24AM (#34115890)
Does this mean that the jokes are already in the training database, and ChatGPT just repeated them?

If not, how does it work exactly? Is there any difference between "a sophisticated pattern matching on a (very huge) corpus" and how a human would invent a joke?

Re:A New Chat Bot Is a ‘Code Red’ for Google’s Search Business by scotty79 on Saturday December 24, 2022 @08:03AM (#34116438)
I think the difference is that humans have underlying model of reality while Chat GPT, stable diffusion and such don't have any.

When you are an novice artist it's usually bad thing to rely on your mental model of reality. Children draw like that. Instead it's better to just observe patterns of light and darkness on the model and reproduce them. But at some point of that, when you start being creative with your art it really pays off to actually know how many fingers humans do have.

It doesn't mean neural networks are completely incapable of creating the model of reality, AlphaGo creates models of Go reality that's better than human players, they just can't do that through language alone.

Re:A New Chat Bot Is a ‘Code Red’ for Google’s Search Business by olivierduval on Saturday December 24, 2022 @11:12AM (#34118154)
There was some articles here about some people asking to ChatGPT to explain jokes... and it wasn't really convincing.

Surely there's some jokes in the training database... enought to allow generating "new ones" by switching pieces

The question about: are humans doing differently is the one about creation. Let's say that maybe 90% a "just" simple pattern matching (same mechanic as already existing jokes) and 10% is new mechanic (original joke)

Re:A New Chat Bot Is a ‘Code Red’ for Google’s Search Business by gcanyon on Saturday December 24, 2022 @12:33PM (#34118989)
> generating "new ones" by switching pieces

I think that's a bit of a simplification :-)