Re:Sumerian dog jokes, or the difficulty of translating dead...
by andai on Monday March 21, 2022 @10:45AM
(#30754714)
GPT-3 handles idioms just fine. Here I tested it on "I fell for her." https://files.catbox.moe/lp6oyg.jpeg
[ Parent
| on HN ]
Re:Sumerian dog jokes, or the difficulty of translating dead...
by jchmrt on Monday March 21, 2022 @11:01AM
(#30754895)
You're missing the point of the parent comment: GPT-3 can understand this idiom because it was trained on a corpus in which the context for this idiom already existed. If a new idiom would emerge, the system would not necessarily be able to handle it if it can not understand it from the context it was trained on. Therefore, a translating AI needs to be continuously updated.
Re:Sumerian dog jokes, or the difficulty of translating dead...
by kbelder on Monday March 21, 2022 @12:03PM
(#30755643)
Is that any different than a human? They can be pwnded by new idioms.
Re:Sumerian dog jokes, or the difficulty of translating dead...
by ufmace on Monday March 21, 2022 @01:03PM
(#30756643)
I think Humans are pretty good at at least recognizing that a particular phrasing doesn't make sense as a literal statement and so must be a reference to something. Often you can get an idea of what it's meant to mean just by context. Sometimes if you see a dozen or so usages, you get the idea of what it means without ever having it explicitly explained.
Re:Sumerian dog jokes, or the difficulty of translating dead...
by lupire on Monday March 21, 2022 @01:20PM
(#30756940)
One of the main differences between humans and ML is that humans learn in far fewer examples than machines.
"Poverty of the stimulus"
Re:Sumerian dog jokes, or the difficulty of translating dead...
by andai on Monday March 21, 2022 @06:40PM
(#30760683)
Until the models become more sophisticated than human brains. Then humans will need more examples than a machine would to learn the same thing.
Re:Sumerian dog jokes, or the difficulty of translating dead...
by jchmrt on Monday March 21, 2022 @12:20PM
(#30755921)
No it isn't of course, but that speaks for the argument that AGI is necessary for human-level translation :)
Re:Sumerian dog jokes, or the difficulty of translating dead...
by andai on Monday March 21, 2022 @06:36PM
(#30760644)
Or just an up-to-date GPT?
Re:Sumerian dog jokes, or the difficulty of translating dead...
by TillE on Monday March 21, 2022 @01:32PM
(#30757156)
Good luck accurately machine translating the infinitely growing idiom of jokey Twitter conversation, which most native speakers can pick up pretty quickly.
Re:Sumerian dog jokes, or the difficulty of translating dead...
by xyzzyz on Monday March 21, 2022 @12:21PM
(#30755943)
Like, for example, “to be pwned”, which I believe is not going to be understood by majority of English speakers.
Re:Sumerian dog jokes, or the difficulty of translating dead...
by mcguire on Monday March 21, 2022 @02:26PM
(#30757823)
And even fewer ML proggies.
Re:Sumerian dog jokes, or the difficulty of translating dead...
by andai on Monday March 21, 2022 @06:38PM
(#30760670)
Ackshually... :)
Re:Sumerian dog jokes, or the difficulty of translating dead...
by biztos on Monday March 21, 2022 @11:15AM
(#30755038)
"The speaker became attracted to the person they are talking about" is definitely not the way I (native US English speaker) would explain falling for someone, and any person or robot using it that way is likely to sow confusion.
How does it do with "I fell for it?"
Re:Sumerian dog jokes, or the difficulty of translating dead...
by MauranKilom on Monday March 21, 2022 @02:40PM
(#30758011)
"Falling for someone" can mean both "falling in love with someone" and "to be trapped/tricked by someone" according to both my experience and my go-to dictionary [1] [2]. "Falling for something" is clearly in the realm of "being tricked" according to [3] (but that source also puts "falling for somebody" squarely on the "love" side of things [4]).
So I would say that, while you may have never heard it used that way, it certainly has that meaning in practice to many people. Don't judge the robot so harshly.
[1]: https://dict.leo.org/pages/addinfo/addInfo.php?aiid=En842ho0...
[2]: https://dict.leo.org/pages/addinfo/addInfo.php?aiid=EKHR2Car...
[3]: https://dictionary.cambridge.org/dictionary/english/fall-for...
[4]: https://dictionary.cambridge.org/dictionary/english/fall-for...
Re:Sumerian dog jokes, or the difficulty of translating dead...
by andai on Monday March 21, 2022 @06:41PM
(#30760700)
Passed the test: https://files.catbox.moe/f1b7ar.jpeg