News for hackers. Stuff that matters.
Re:People tricking ChatGPT “like watching an Asimov novel co... by blihp on Friday December 02, 2022 @12:58PM (#33834105)
It can only interpolate, not extrapolate. So the 'new' things you're seeing are just rearrangements of the (millions/billions of) things that the DNN was trained on. It has no understanding of what it has 'learned' (or more accurately: lossy memorization a.k.a. compression) and makes all kinds of mistakes (some due to training losses, some due to garbage/conflicting data fed in.) This is probably why the creative applications (i.e. Stable Diffusion etc) seem more impressive than the functional applications (i.e. Galactica) as even 'wrong' output can be creatively interesting.

For example, if a new comic/movie/video game character came out tomorrow that had a very unique physical look, Stable Diffusion would have difficulty even approximating it (i.e. its training data wouldn't have what was needed to reproduce the appearance.) But it can produce a decent Darth Vader because it's probably been fed at least thousands of drawings/photos of this very well known fictional character.

Re:People tricking ChatGPT “like watching an Asimov novel co... by krackers on Friday December 02, 2022 @01:53PM (#33835002)
That's like saying the novels people write are just rearrangements of words we learned as a kid. I don't see how you can't possibly consider something like this [1] as extrapolation and genuine creation.

[1] https://twitter.com/pic/orig/media%2FFi4HMw9WQAA3j-m.jpg

Re:People tricking ChatGPT “like watching an Asimov novel co... by renewiltord on Friday December 02, 2022 @02:04PM (#33835173)
link broken
Re:People tricking ChatGPT “like watching an Asimov novel co... by krackers on Friday December 02, 2022 @07:39PM (#33838961)
Re:People tricking ChatGPT “like watching an Asimov novel co... by visarga on Friday December 02, 2022 @03:16PM (#33836262)
Exactly, interpolation in combinatorial space becomes extrapolation.
Re:People tricking ChatGPT “like watching an Asimov novel co... by Filligree on Friday December 02, 2022 @02:01PM (#33835114)
You need about ten pictures for Dreambooth to give Stable Diffusion a good idea of what a new character looks like.
Re:People tricking ChatGPT “like watching an Asimov novel co... by seydor on Friday December 02, 2022 @03:24PM (#33836384)
extrapolation is interpolation between things that haven't been interpolated before, so i wouldnt be so sure about it. Its objective is not to go after unfamiliar routes, but it can be trained to do so