News for hackers. Stuff that matters.
Re:Human or Machine: Can You Tell Who Wrote These Poems? by blowski on Monday June 27, 2016 @04:28PM (#11989208)
Poetry that scans correctly should be fairly easy to write for a machine - just find words with the right rhythm patterns and rhymes. Poetry that connects on an emotional level must be a lot harder.
Re:Human or Machine: Can You Tell Who Wrote These Poems? by andreaferretti on Monday June 27, 2016 @04:30PM (#11989228)
I was tricked by "A thousand pictures on the kitchen floor, Talked about a hundred years or more."
Re:Human or Machine: Can You Tell Who Wrote These Poems? by gridspy on Monday June 27, 2016 @04:42PM (#11989313)
I got 6/6

I didn't even read that far. It was obvious by here:

SONNET #2

    The dirty rusty wooden dresser drawer.
    A couple million people wearing drawers,
    Or looking through a lonely oven door,
    Flowers covered under marble floors.
This is exactly how a computer algorithm would conflate drawer with drawers. There is no obvious theme to this verse, no high level construct.

Every human poem in this example has a high level theme, which is non-obvious to a computer. None of the computer ones do.

Re:Human or Machine: Can You Tell Who Wrote These Poems? by chrisfosterelli on Monday June 27, 2016 @04:56PM (#11989412)
That's how I got 6/6 as well. It's less about the actual words and more about if the poem was actually talking about anything coherent.
Re:Human or Machine: Can You Tell Who Wrote These Poems? by plaguuuuuu on Monday June 27, 2016 @10:57PM (#11991190)
Also interesting to compare with less thematically structured work. Probably not the greatest example but what comes to my mind is some of The Mars Volta's lyrics; a lot of it is pretty abstract and stream-of-consciousness and it's hard to really pinpoint a narrative as such, compared to the example poems which were pretty straightforward

    "Last night I heard lepers
    flinch like birth defects
    its musk was fecal in origin
    as the words dribbled off of its chin
    it said I'm lost
    I'm lost
    
    Now I'm lost
    
    Dolls wreck the minced meat of pupils
    cast in oblong arms length
    the hooks have been picking their scabs
    where wolves hide in the company of men
    it said I'm lost
    I'm lost"
Re:Human or Machine: Can You Tell Who Wrote These Poems? by mfoy_ on Monday June 27, 2016 @05:03PM (#11989464)
All the computer poems were just rambling and rhyming and weren't really even trying to say anything. A lot of the time they phrased things VERY awkwardly too, to the point of being incomprehensible.
Re:Human or Machine: Can You Tell Who Wrote These Poems? by elorant on Monday June 27, 2016 @06:11PM (#11989935)
Sounds like rap music :)
Re:Human or Machine: Can You Tell Who Wrote These Poems? by Scriptor on Monday June 27, 2016 @05:29PM (#11989657)
Yep, the human poems would often refer back to an idea or word mentioned before. The computer poems read like something from a good markov generator.

Actually, you can kind of reverse engineer the algorithm behind Sonnet #2. It seems like they first pick a bunch of related words that rhyme (drawer, door, floors, apartment, wall) and then build up the line backwards. The problem is that even though the words are related, the actual lines don't form any single cohesive image.

Re:Human or Machine: Can You Tell Who Wrote These Poems? by SilasX on Monday June 27, 2016 @05:30PM (#11989669)
>This is exactly how a computer algorithm would conflate drawer with drawers.

Because human poets never do wordplay like that?

Re:Human or Machine: Can You Tell Who Wrote These Poems? by gridspy on Monday June 27, 2016 @05:35PM (#11989698)
Because when humans do, there is an obvious (sometimes less obvious, but present) reason to do so.

There is no such link made in this example between the usages.

Re:Human or Machine: Can You Tell Who Wrote These Poems? by SilasX on Monday June 27, 2016 @05:47PM (#11989788)
You haven't read a lot of schoolkid poetry posted at public libraries, have you?
Re:Human or Machine: Can You Tell Who Wrote These Poems? by qu4z-2 on Monday June 27, 2016 @06:16PM (#11989957)
That's what I found. All the "human" ones were easy, but then you had to play "machine or awful poet?" on the rest.
Re:Human or Machine: Can You Tell Who Wrote These Poems? by vacri on Monday June 27, 2016 @09:15PM (#11990813)
I answered 'human' for drawer/drawers, because "surely an algorithm would be designed to avoid this kind of thing? surely it'd be better than that... must just be a bad poet"
Re:Human or Machine: Can You Tell Who Wrote These Poems? by hoke_t on Monday June 27, 2016 @10:36PM (#11991114)
Are you implying that awful poets are in fact not human?
Re:Human or Machine: Can You Tell Who Wrote These Poems? by qu4z-2 on Tuesday June 28, 2016 @05:13PM (#11997640)
I believe I could make a solid argument for that. :P

But no, it's just that all the bad poets in the original article were machines in the end.

Re:Human or Machine: Can You Tell Who Wrote These Poems? by arcticfox on Monday June 27, 2016 @06:13PM (#11989945)
I'm not sure that the majority of that really qualifies as poetry, at least not in a man vs. machine context.
Re:Human or Machine: Can You Tell Who Wrote These Poems? by neosat on Monday June 27, 2016 @09:57PM (#11990964)
I got this one wrong. I thought no way a computer would be so dumb to have drawer and then drawers in the next sentence and this was a trick question to get one to say machine. Guess I overestimated the algorithm !
Re:Human or Machine: Can You Tell Who Wrote These Poems? by taneq on Tuesday June 28, 2016 @03:50AM (#11992150)
Inability to differentiate homonyms is one of the current weaknesses of word embeddings, isn't it?
Re:Human or Machine: Can You Tell Who Wrote These Poems? by SilasX on Monday June 27, 2016 @04:36PM (#11989271)
Right, because you have to convince the high-status authorities to say that it connects on an emotional level so that everyone else will nod their heads to avoid looking stupid.

Truly, AI is a long way from beating the Emperor's New Clothes game.

But frankly, there are easier, more useful AI goals to target.

Re:Human or Machine: Can You Tell Who Wrote These Poems? by Scriptor on Monday June 27, 2016 @05:34PM (#11989692)
I'm not a high-status authority and I was still able to connect emotionally to the human ones. Or, at the very least, each line contributed to a consistent mental picture or idea.
Re:Human or Machine: Can You Tell Who Wrote These Poems? by r00fus on Monday June 27, 2016 @05:42PM (#11989752)
I found an overarching theme or message above and beyond the words in the human written ones (guess 5 of 6 correctly). This isn't just a theme tying together the lines, it's more of an arc of understanding.

Of course, I did incorrectly guess that one of the poems was written by a machine, when it was a human.

Re:Human or Machine: Can You Tell Who Wrote These Poems? by justratsinacoat on Monday June 27, 2016 @05:11PM (#11989534)
>Right, because you have to convince the high-status authorities to say that it connects on an emotional level so that everyone else will nod their heads to avoid looking stupid

Honest question -- did you get the same emotional read off of the machine-poems as you did the human-poems? If not, perhaps there is something more involved in poetry than stringing words together!

Re:Human or Machine: Can You Tell Who Wrote These Poems? by SilasX on Monday June 27, 2016 @05:27PM (#11989644)
>Honest question -- did you get the same emotional read off of the machine-poems as you did the human-poems?

Yep -- none.

Re:Human or Machine: Can You Tell Who Wrote These Poems? by ythl on Monday June 27, 2016 @05:34PM (#11989693)
Hmm, well I was able to correctly identify every single sonnet. The machine generated ones I would read and think "What the heck was that poem about? It just rambled on about random things" whereas the human ones you could tell that all the verses were interconnected.

Take Sonnet #6 for example. You can tell there is intelligence behind the sentences being written. Each line builds on the line before it. Compare to sonnet #5 which rambles on about nothing and uses duplicate words (then comes a small bright spark comes)...

Re:Human or Machine: Can You Tell Who Wrote These Poems? by thaumasiotes on Monday June 27, 2016 @05:53PM (#11989828)
From my perspective, sonnet #6 was easily the best technically. That doesn't mean I connected with it emotionally, but someone could.

Generally, there's a poem (more than one even) to fit any person's taste. patio11 has quoted one before, which is meaningful to him:

    I went to find the pot of gold
    that's waiting where the rainbow ends
    I searched and searched and searched and searched
    and searched and searched, and then
    there it was, deep in the grass
    under an old and twisty bough
    It's mine, it's mine, it's mine at last
    What do I search for now?
Rudyard Kipling wrote a number of poems about pragmatism, among other things; here's a verse of Dane-geld:

    It is wrong to put temptation in the path of any nation
    for fear they should succumb and go astray
    So when you are requested to pay up or be molested
    you will find it better policy to say:
    We never pay anyone Dane-geld, no matter how trifling the cost
    For the end of that game is oppression and shame
    and the nation that plays it is lost!
Here's a verse of Rising of the Moon that appeals to the same (very popular!) basic themes as jingoism does:

    All along that singing river, that black mass of men was seen
    High above their shining weapons flew their own beloved green
    Death to every foe and traitor, whistle out the marching tune
    And our army buys her freedom at the rising of the moon
All of those are high-quality poems.

The problem comes in with an upper-class movement to distinguish themselves from the rubes who appreciate good poetry by removing all the things that make it good. The problem SilasX identifies is real, and you can earn a lot of acclaim today writing awful, rhythmless, rhymeless, themeless stuff and calling it poetry. Compounding the problem, this terrible high-prestige form is what you'll learn about if you decide to take a poetry class. But we shouldn't let it ruin our view of what poetry can be.

Re:Human or Machine: Can You Tell Who Wrote These Poems? by dempseye on Tuesday June 28, 2016 @03:09AM (#11991989)
> this terrible high-prestige form is what you'll learn about if you decide to take a poetry class

While there are classes in post-modern poetry, most poetry classes are not that.

How many poetry classes have you taken?

Re:Human or Machine: Can You Tell Who Wrote These Poems? by thaumasiotes on Tuesday June 28, 2016 @03:20AM (#11992029)
Fair enough. My experience with poetry classes is limited to elementary school and middle school. Our middle school curriculum consisted of badmouthing poetry that somebody somewhere might have actually liked. The school was proud of having classes taught by a published poet.
Re:Human or Machine: Can You Tell Who Wrote These Poems? by dempseye on Tuesday June 28, 2016 @03:43AM (#11992125)
It's entirely possible that you were taught by a pseud. That's unfortunate if so.

I did a degree in English lit. The poetry classes I took looked something like this:

- Old and Middle English Poetry (Beowulf, Chaucer, etc.)

- Elizabethan Poetry

- Paradise Lost

- The Shakespearean Sonnet

- 18th Century Classicism (Alexander Pope, etc.)

- Victorian Poetry (Tennyson, Matthew Arnold, etc.)

- 20th Century Irish Poetry (Yeats, that kind of thing)

- 20th Century American Modernism

Only in the last class was there was anything like you described, and even then it only made up a fraction of the material covered.

Here is one of the most critically acclaimed poems of the last 40 years. It's perfectly easy to understand. http://www.poetrybyheart.org.uk/poems/a-martian-sends-a-post...

Re:Human or Machine: Can You Tell Who Wrote These Poems? by SilasX on Monday June 27, 2016 @05:50PM (#11989802)
You've never seen a human poem that just seemed to ramble about nothing?
Re:Human or Machine: Can You Tell Who Wrote These Poems? by plus on Monday June 27, 2016 @06:04PM (#11989900)
In this particular case I think it was fairly obvious, not so much because of the meaningfulness of the human-written poems (though the poems that were written by humans did clearly have meaning associated with them), but more because the machine-written poems were very awkward.

Sonnet 1 was about a person mourning their mother who died in a car accident. It read well and made sense, so I would have been very surprised if it were written by a machine.

Sonnet 2 didn't make sense, but more than that there were very awkward constructs. Rhyming "drawer" (the furniture) with "door" and "drawers" (the undergarments) with "floors" in the same quatrain reads very poorly. "Sergeant" does not rhyme with "apartment".

Sonnet 3 was about something (a growing plant), and it reads well, so it was written by a human.

Sonnet 4 was about something (Joy, a personification of the emotion), and it read well. "Joy" being consistently capitalized throughout was a subtlety that convinced me it was written by a human.

Sonnet 5 had more awkward constructs. "Shame" and "Tame", "Inflame" and "Came" in the same stanza. "Bring" and "wandering" don't really rhyme. The last stanza is just weird -- "hear" is supposed to rhyme with "cheer", "cheers" (which is the line right before "cheer"...) is supposed to rhyme with "roars" (?), and "nights" is supposed to rhyme with "respects"? Again, it didn't really make any sense.

Sonnet 6 was similar to Sonnet 3. It's about something (a growing plant again), and it reads well again.

Re:Human or Machine: Can You Tell Who Wrote These Poems? by Kluny on Monday June 27, 2016 @06:02PM (#11989886)
Bad ones, sure. But I got all 6 poems right in that case as well. I had to read them carefully and think about it, but I still got them all.
Re:Human or Machine: Can You Tell Who Wrote These Poems? by dempseye on Tuesday June 28, 2016 @03:16AM (#11992013)
Did you get them?

Did you recognise, for instance, that the first poem is the poet's recollection of cancer ravaging her mother, and of how she walked to the hospital every day to see her?

Did you understand and just not care, or did you not understand and so find nothing to care about?

Re:Human or Machine: Can You Tell Who Wrote These Poems? by justratsinacoat on Monday June 27, 2016 @06:22PM (#11989992)
Here I was, writing a draft response about this personally unprecedented phenomenon of someone who lacked any sense of poetics at all, but I quickly realized that isn't necessarily the case. No one has asked you the right question -- could you tell the poems apart? I bet you could.
Re:Human or Machine: Can You Tell Who Wrote These Poems? by mfoy_ on Monday June 27, 2016 @05:10PM (#11989525)
I'm guessing you don't like poetry.
Re:Human or Machine: Can You Tell Who Wrote These Poems? by p4wnc6 on Monday June 27, 2016 @04:30PM (#11989229)
But like most art, whether it connects on an emotional level is mostly dependent on the consumer. Once an artist gains fame, then it becomes a matter of fashion signalling to agree with others about how good that artist is or to deride that artist for making something that doesn't live up to previous works.

I found a lot of the lines from The Policeman's Beard is Half-Constructed by the program Racter to connect with me on an emotional level, despite knowing that (a) it was likely heavily edited by the program creator and (b) much of it just mimicked the unusual word choices and rhythmic qualities of poetry, not the intentional conveyance of a message or theme.

Re:Human or Machine: Can You Tell Who Wrote These Poems? by TheOtherHobbes on Monday June 27, 2016 @08:07PM (#11990530)
>But like most art, whether it connects on an emotional level is mostly dependent on the consumer.

Consumers. The best art affects a lot of people. And they don't need to be told to like it. It "just works."

Art audiences follow multivariate statistical distributions. It's very much not just a personal reaction - it's a personal reaction shared by many other people having broadly similar reactions.

Some of it is social signalling, and some of it requires education and experience.

But valued works tend to persist in culture because they reliably create reactions in a statistically significant proportion of all possible audiences.

Re:Human or Machine: Can You Tell Who Wrote These Poems? by gridspy on Monday June 27, 2016 @05:38PM (#11989718)
That's the interesting thing about looking through the output of any computer algorithm. I have often done this with random walks using markov chains.

By editing 200 lines into just 3 or 4, you are actually adding a lot of information. It makes the computer seem smarter than it is.

If we could create a "good poem" evaluator + editor and tack it on the end of a "random poem" creator, we could perhaps get some good results.

Re:Human or Machine: Can You Tell Who Wrote These Poems? by justratsinacoat on Monday June 27, 2016 @05:07PM (#11989497)
>Poetry that scans correctly should be fairly easy to write for a machine - just find words with the right rhythm patterns and rhymes

Indeed, Pentametron [0] ('With algorithms subtle and discreet/I seek iambic writings to retweet') has been up since 2012. Despite the occasional serendipitous pairing, it obviously doesn't make much sense, as didn't the obvious machine-poems in TFA.

[0]https://twitter.com/pentametron

Re:Human or Machine: Can You Tell Who Wrote These Poems? by thaumasiotes on Monday June 27, 2016 @05:30PM (#11989661)
Just to point out, human poems, and in fact the poems here, often don't scan or rhyme correctly.