News for hackers. Stuff that matters.
Re:Sumerian dog jokes, or the difficulty of translating dead... by jchmrt on Monday March 21, 2022 @11:01AM (#30754895)
You're missing the point of the parent comment: GPT-3 can understand this idiom because it was trained on a corpus in which the context for this idiom already existed. If a new idiom would emerge, the system would not necessarily be able to handle it if it can not understand it from the context it was trained on. Therefore, a translating AI needs to be continuously updated.
Re:Sumerian dog jokes, or the difficulty of translating dead... by kbelder on Monday March 21, 2022 @12:03PM (#30755643)
Is that any different than a human? They can be pwnded by new idioms.
Re:Sumerian dog jokes, or the difficulty of translating dead... by ufmace on Monday March 21, 2022 @01:03PM (#30756643)
I think Humans are pretty good at at least recognizing that a particular phrasing doesn't make sense as a literal statement and so must be a reference to something. Often you can get an idea of what it's meant to mean just by context. Sometimes if you see a dozen or so usages, you get the idea of what it means without ever having it explicitly explained.
Re:Sumerian dog jokes, or the difficulty of translating dead... by lupire on Monday March 21, 2022 @01:20PM (#30756940)
One of the main differences between humans and ML is that humans learn in far fewer examples than machines.

"Poverty of the stimulus"

https://en.wikipedia.org/wiki/Poverty_of_the_stimulus

Re:Sumerian dog jokes, or the difficulty of translating dead... by andai on Monday March 21, 2022 @06:40PM (#30760683)
Until the models become more sophisticated than human brains. Then humans will need more examples than a machine would to learn the same thing.
Re:Sumerian dog jokes, or the difficulty of translating dead... by jchmrt on Monday March 21, 2022 @12:20PM (#30755921)
No it isn't of course, but that speaks for the argument that AGI is necessary for human-level translation :)
Re:Sumerian dog jokes, or the difficulty of translating dead... by andai on Monday March 21, 2022 @06:36PM (#30760644)
Or just an up-to-date GPT?
Re:Sumerian dog jokes, or the difficulty of translating dead... by TillE on Monday March 21, 2022 @01:32PM (#30757156)
Good luck accurately machine translating the infinitely growing idiom of jokey Twitter conversation, which most native speakers can pick up pretty quickly.
Re:Sumerian dog jokes, or the difficulty of translating dead... by xyzzyz on Monday March 21, 2022 @12:21PM (#30755943)
Like, for example, “to be pwned”, which I believe is not going to be understood by majority of English speakers.
Re:Sumerian dog jokes, or the difficulty of translating dead... by mcguire on Monday March 21, 2022 @02:26PM (#30757823)
And even fewer ML proggies.
Re:Sumerian dog jokes, or the difficulty of translating dead... by andai on Monday March 21, 2022 @06:38PM (#30760670)