News for hackers. Stuff that matters.
Re:This word does not exist by jll29 on Tuesday October 26, 2021 @03:40PM (#29005265)
Computers aren't creative; the excitement about GPT-3 is humans projecting something into its output or filtering the small number of bits that appear to make sense, as you say.

Neural language models are just recycling bits that humans have said before, they address well the "how to say" part of NLG (Natural Language Generation) but fail with respect to the "what to say" part.

Re:This word does not exist by netcan on Tuesday October 26, 2021 @04:12PM (#29005677)
I was starting to write a response, and realised how patterned the debate is.

We've been discussing the topic of machine intelligence since the start of CS and points of contention tend to show up in the same places.

Anyway, it occured to me that if given 10 tries, GPT-3 probably produces my comment adequately. I have an uneasy suspicion that it might take fewer tries than that... especially if prompted with "netcan, please respond."

Anyway, the upshot is that for someone like me, on the "if you can't tell the difference" side of the cliche... your side's insistence that machine's can't be creative makes me doubt my own creativity, to the extent that the argument is convincing.

Re:This word does not exist by revolvingocelot on Tuesday October 26, 2021 @04:54PM (#29006122)
I'm on the "if you can't tell the difference..." side, too, but the issue is the "10 tries" and the prompting. GPT-3 has no ability to revise or reconsider or judge anything it writes. We're still safe, IMO, until the main loop goes

     >generate 10 "netcan comments"
     >drop 5 least conformant results
     >reword remaining comments several times
     >reassess rewordings, select best of each set
     >select 1 most conformant "netcan comment"
Right now (AFAIK, anyway) all GPT-3 does is the first one. Think about how a human is creative -- lots of drafts, lots of dead ends, lots of borrowing, lots of revision. I appreciate that "reflection on its own output" is waaaay out of scope for a glorified, omni-contextual Markov chain, but I think we're safe, both from the threat of GPT-3 being "creative" in the same way we are (and therefore, maybe "alive" in the same way we are) and the threat of our own mental processes being revealed to be as merely computational as those of GPT-3.
Re:This word does not exist by netcan on Tuesday October 26, 2021 @05:24PM (#29006468)
Oh I don't disagree that the "best of gpt-3" on twitter is automated hyperbole machine.^ But I think at least in HN, a lot of people have looked at somewhat more objective sources too. The standard way to prove a trick shot is to film yourself do two or three in a row. I agree these are tricks, and a lot are unproven. Some are proven though, FWIW.

Anyway, if the damn thing can do me 10%-60% of the time in a non trivial context... IDK, maybe this just becomes the default standard for "non trivial." and it's no big deal. It is disconcerting though. In any case, assuming GPT-3 progresses... there might be uses for software that does just the first of those things.

All my above comment really means for sure is that NLP can now participate, simulate and perhaps instigate flame wars better. Flame wars were always one of the easy targets, so that's not much of a standard. Who knows though, maybe the road to AGI is a gradual refinement of a flamewar bot to a dialectic philosopher. Cheating on essays is gonna start getting fun.

^If a person uses the Tom Sawyer fence trick to automate a task, is that automation? If the machine does it, is the turn tables?

Re:This word does not exist by revolvingocelot on Tuesday October 26, 2021 @05:34PM (#29006583)
Absolutely. The "problem" essentially goes away with a cyborg approach: let GPT-3 generate its 10 netcan comments, then have a human do a little refining, maybe reframe the prompt, edit the result a little, and bam! Much scarier! Not that a sufficiently determined human couldn't ape someone's comment style, but GPT-3 is a force multiplier in the same way that sockpuppet management software is for the professional sockpuppeteer -- scales better, more effective, just makes everything easier.

I've heard serious speculation that GPT-3 (or certainly its successors) might find utility for writers as a combination of a ghostwriter and Github Copilot.

>^If a person uses the Tom Sawyer fence trick to automate a task, is that automation? If the machine does it, is the turn tables?

It's not here yet, but the grim day on which I no longer communicate with anyone on the Internet for fear they're not actually a living conversational partner approaches. Even those I can cryptographically prove are people that I know will be suspects: "euurgh, I'm too busy to talk to this guy today, he's so boring. I'll just feed GPT-10 all our old conversations, tell it to be me, aaaand..."

Re:This word does not exist by netcan on Tuesday October 26, 2021 @05:53PM (#29006803)
Messaging apps already do a bare version of suggesting auto-replies. It's mostly it's a texting-while-driving aid, so they keep it concise and uncomplicated. Code completion already exists. Spam. Gradual steps have places to start stepping.
Re:This word does not exist by tremon on Wednesday October 27, 2021 @06:39AM (#29011457)
the "best of gpt-3" on twitter is automated hyperbole machine

Isn't that step 4 in the GP's scary loop? Having the humans do the assessing, then select the best by counting the number of likes/retweets?

Re:This word does not exist by hooande on Tuesday October 26, 2021 @06:12PM (#29007015)
this is the only way to reliably use GPT-X in a production setting. you have to postprocesses the responses with a second model, until you find one that is 1) reasonable 2) coherent 3) related to the topic of the prompt
Re:This word does not exist by thereddaikon on Tuesday October 26, 2021 @04:34PM (#29005892)
That fact that humans can be creative does not mean that all humans are. Nor does it mean its actually all that common. True creativity is very rare. Even people we normally describe as "creatives" are mostly working off of convention and are influenced by others.

I've come to accept that 99% of what humanity does is derivative and mediocre. That's ok.

Re:This word does not exist by netcan on Tuesday October 26, 2021 @05:26PM (#29006490)
A machine sticking that mirror in our face is still gonna be weird.
Re:This word does not exist by avgcorrection on Tuesday October 26, 2021 @04:44PM (#29006025)
I’m predictable ergo AI.
Re:This word does not exist by netcan on Tuesday October 26, 2021 @05:25PM (#29006477)
No. I'm predictable, ergo weak AI is predicting me... thus making me self conscious about by predictability.
Re:This word does not exist by otabdeveloper4 on Wednesday October 27, 2021 @01:47AM (#29009962)
Well, yes. GPT-3 is basically just a huge index of internet content. (Mostly UGC like comments and such?)

So all it means is that your "internet voice" tends towards a generic baseline average.

tldr - be more original and don't follow the hivemind.

Re:This word does not exist by netcan on Wednesday October 27, 2021 @07:48AM (#29011936)
pretty much the point I was going for, except the tldr is, I'm not liking this theoretical morros showing how unoriginal I am.
Re:This word does not exist by sdenton4 on Tuesday October 26, 2021 @04:21PM (#29005756)
Spend some time with the slush pile at a magazine... Human creative output is also heavily filtered and selected for.
Re:This word does not exist by skulk on Tuesday October 26, 2021 @05:03PM (#29006233)
I think the point is that this slush pile needs to be automated as well before the hype around GPT-3 is realized.
Re:This word does not exist by black_knight on Tuesday October 26, 2021 @04:10PM (#29005646)
> humans projecting something into its output or filtering the small number of bits

I think this has value and is an interesting form of machine assisted creation.

There is something similar, but more simplistic (no AI, just old-school RNGs), going on in generative music. For modular synthesizers, some of the more popular modules are random sequence generators [0]. These allow the musician to generate random elements of the music, say melody or drum pattern, but curate it. You might generate dozens of elements, carefully tweaking parameters, before you hear "the right one" – which you then actually use in the music.

I guess my point is, curation of generated material is a form of creation! The generator is perhaps not the creator, but it is useful to develop better generators.

[0] : such as “Turing Machine” from Modular Thing and “Marbles” from Mutable Instruments.

Re:This word does not exist by ravi-delia on Tuesday October 26, 2021 @04:30PM (#29005864)
I wonder how much of that is due to the task GPT-3 was trained for? Perhaps the "what to say" part is working perfectly, but what it wants to say is as generic a text stream as possible. It already seems like GPT-3 has more "knowledge" than is obvious at first glance, but you need to prompt it correctly.
Re:This word does not exist by gmaster1440 on Tuesday October 26, 2021 @04:26PM (#29005825)
Maybe computers aren't creative, but imo there's a stronger argument to discount creativity in the first place then: https://www.markfayngersh.com/post/the-thinking-placebo
Re:This word does not exist by andybak on Tuesday October 26, 2021 @04:05PM (#29005574)
> the small number of bits that appear to make sense.

What I find most impressive is just how much of it's output appears to make sense.

Of course "make sense" is the critical part of this. It's skin deep - but still quite astonishing fairly frequently.

Re:This word does not exist by plutonorm on Tuesday October 26, 2021 @04:44PM (#29006032)
is it skin deep though?
Re:This word does not exist by andybak on Tuesday October 26, 2021 @05:03PM (#29006229)
Well it's certainly fragile and easily lost.

Are you implying some deeper understanding in GPT3?

Re:This word does not exist by plutonorm on Thursday October 28, 2021 @07:57AM (#29024992)
I agree it's fragile and dreamlike - but it is in my opinion genuine understanding. If you have or ever do have children you can observe them pass through a similar kind of stage, fractured incomplete understanding, dreamlike, yet still understanding. It crystallises slowly overtime. I predict the same will happen as we expand the models and add more complexity.
Re:This word does not exist by smoldesu on Tuesday October 26, 2021 @11:06PM (#29009139)
Your statement that computers aren't creative is not true in general and it's especially not true for GPT-3. It can generate text that appears random at first glance but which has a structure hidden within. As I wrote above, there is no way to prove conclusively whether any given sentence generated by GPT-3 was actually written by GPT-3. But if we assume that all sentences were indeed written by GPT-3 then some of them must be very good indeed because many people find them interesting and worth reading. That means that GPT-3 has demonstrated creativity.

(a response generated by GPT-3)

Re:This word does not exist by joeberon on Wednesday October 27, 2021 @09:59AM (#29013354)
I feel like this implies that creativity is the creation of the interpretation of a work rather than literally its creation and I don't really agree with that conclusion.