News for hackers. Stuff that matters.

A comment on The computers are getting better at writing.

Re:The computers are getting better at writing by causality0 on Monday May 03, 2021 @09:55PM (#27033254)
GPT-3-generated writing is a combination of comically absurd and incredibly deep. The weak infants of the woman next door who had to be picked up with the tongs and thrown into the dustbin is quite silly but then there's He wanted to crawl away from it, but there was no place to go. which is a surprisingly deep statement about the revulsion he feels towards himself. That a computer can generate that says very uncomfortable things about the skill of humans in recognizing genuine creative significance.
[ Parent | on HN ]
Re:The computers are getting better at writing by throwawaygh on Monday May 03, 2021 @10:21PM (#27033407)
> which is a surprisingly deep statement

People used to say the same thing about Markov chains, and then the hype died down it took 20 years for another hypetrain to pull into the station. The same will happen with GPT-n.

> says very uncomfortable things about the skill of humans in recognizing genuine creative significance.

Indeed. People see pictures in clouds and omnipotent beings in the stars. Humans are uncomfortably good at finding meaning in nothings.

[ Parent | on HN ]
Re:The computers are getting better at writing by fapjacks on Tuesday May 04, 2021 @01:57AM (#27034466)
My biggest problem with people the world round is invariably rooted in this sense of ownership of what other people find meaningful. This kind of top-down dictation of ultimately subjective meaning is what is uncomfortable (because meaning is a form of tacit knowledge and therefore incommunicable) and is the path to inquisitions, woke / oracular authoritarian thought-policing regimes with reeducation camps.
[ Parent | on HN ]
Re:The computers are getting better at writing by kumarvvr on Monday May 03, 2021 @11:35PM (#27033824)
And other people reward those findings with money. Good writing is hard. Writing that evokes emotions in others is even harder.
[ Parent | on HN ]
Re:The computers are getting better at writing by watwut on Tuesday May 04, 2021 @02:45AM (#27034679)
It is extraordinary rare to ear money by writing. It may be hard, but people dont reward it with cash.
[ Parent | on HN ]
Re:The computers are getting better at writing by throwawaygh on Wednesday May 05, 2021 @06:16PM (#27056514)
Exactly. Getting people to see patterns is easy. Getting people to fork over money based on those perceptions is much more difficult. Ask any church plant.
[ Parent | on HN ]
Re:The computers are getting better at writing by nl on Monday May 03, 2021 @11:44PM (#27033864)
The limitations of Markov chains are obvious within hours of starting to use them. GPT-3, less-so.
[ Parent | on HN ]
Re:The computers are getting better at writing by cageface on Monday May 03, 2021 @10:56PM (#27033588)
What applications are Markov chains used in now?
[ Parent | on HN ]
Re:The computers are getting better at writing by Mordisquitos on Tuesday May 04, 2021 @04:56AM (#27035409)
Sequence analysis in Bioinformatics, for example to align sequences and detect homology and as in HMMER: http://hmmer.org/
[ Parent | on HN ]
Re:The computers are getting better at writing by amarant on Tuesday May 04, 2021 @02:13AM (#27034537)
Kubernetes uses them to come up with random generated cluster names if you don't provide a name of your own..I bet many other applications use them in a similar manner
[ Parent | on HN ]
Re:The computers are getting better at writing by FractalHQ on Tuesday May 04, 2021 @04:01AM (#27035044)
Crypto currencies and decentralized protocols like the libp2p (used in IPFS) like Markov chains iirc
[ Parent | on HN ]
Re:The computers are getting better at writing by swiley on Monday May 03, 2021 @10:28PM (#27033446)
Deep statements are deep because the communicate feeling, if the machine never felt anything but tripped over meaning like this (and it's pretty obvious it's just gluing things together) it really dulls the effect.
[ Parent | on HN ]
Re:The computers are getting better at writing by bikeshaving on Monday May 03, 2021 @10:41PM (#27033513)
Who’s to say that our greatest writers didn’t “trip over meaning”? A lot of poetic processes involve finding, curating and re-contextualizing interesting phrases (see found poetry), and there’s potentially a lot of value in applying the same process to computer-generated writing.
[ Parent | on HN ]
Re:The computers are getting better at writing by mponw on Tuesday May 04, 2021 @02:20AM (#27034577)
I am wondering if we call some writers great because of what they did not, could not or cannot express (anymore). By their limited and graspable existence they serve as targets for our projections, whereas an AI is less attractive for that purpose, at least in my view.

I'd rather think about the authors of AIs, their assumptions and their worldview.

[ Parent | on HN ]
Re:The computers are getting better at writing by tsimionescu on Tuesday May 04, 2021 @01:58AM (#27034468)
That's why no one is truly moved by a single phrase. We often quote memorable bits from larger works ("to be, or not to be"), but that quote is only memorable because the entire work makes us believe that it is not an accident.
[ Parent | on HN ]
Re:The computers are getting better at writing by exporectomy on Tuesday May 04, 2021 @02:09AM (#27034522)
I was by a famous 6 word poem: "For sale: Baby shoes. Never worn."
[ Parent | on HN ]
Re:The computers are getting better at writing by watwut on Tuesday May 04, 2021 @02:47AM (#27034683)
Yeah. But the thing is, after you have own baby, you may find yourself with like 5 pairs of never worn baby shoes.

So while it somewhat suggest death, it is only because of the literally context, which makes you expect something deep. If you seen that in an ad, you would not feel the same.

[ Parent | on HN ]
Re:The computers are getting better at writing by tsimionescu on Tuesday May 04, 2021 @02:16AM (#27034552)
Sure, there are exceptions. And for those exceptions it may be fair to say that perhaps they were just a lucky stumble.

Even here I do wonder how well this poem would be remembered if it weren't associated with Hemingway.

[ Parent | on HN ]
Re:The computers are getting better at writing by chillacy on Wednesday May 05, 2021 @12:13PM (#27051808)
Today at least all the gpt3 we read is still hand selected by another human, so if it communicated feeling in the editor, we get to read it.
[ Parent | on HN ]
Re:The computers are getting better at writing by notahacker on Tuesday May 04, 2021 @05:22AM (#27035525)
Is it "surprisingly deep" though? Looks like two standard cliches of human writing often used in close proximity and the wider context suggests literal motion (which is also present in the silly line about the weak infants!)

I did like "fuzzy belly" tbf, and Kafka himself might have appreciated the purely serendipitous irony of a line about "the bugs his father used to bring him as a little boy"

[ Parent | on HN ]
Re:The computers are getting better at writing by bckr on Tuesday May 04, 2021 @01:58AM (#27034467)
I was actually taken in by the infants-in-the-dustbin image. I thought it was gruesome, then I reflected on how infant mortality has decreased and what a better time we're living in. This article was uncanny valley for me.
[ Parent | on HN ]
Re:The computers are getting better at writing by intergalplan on Tuesday May 04, 2021 @11:25AM (#27038593)
Writers use all kinds of tools to "cheat", up to and including not actually writing. Mining computer-generated nonsense or coherent-but-empty prose for the odd accidentally-excellent phrase or sentence might end up being just another. Hell, it may already be.
[ Parent | on HN ]