News for hackers. Stuff that matters.
Re:Using AI to match human performance in translating news f... by foldr on Thursday March 15, 2018 @08:40AM (#16592284)
Impressive, but there's an easy formula for getting these systems to make mistakes. Just input a sentence with some kind of long distance dependency. For example, DeepL gets agreement right in English to Spanish translations when the two things that agree are close together:

    I like soup -> COMO sopa
    They eat soup -> COMEN sopa
Impressively, it can even get agreement correct across clause boundaries in many cases. But if you do wh-movement through two or more clauses, you're usually out of luck:

    Which boys does he say he believes eat soup?
    ->
    ¿Qué chicos dice que cree que COME sopa? [should be COMEN]
It doesn't really matter very much in practice if an MT system makes mistakes like this, but they are mistakes that you can rely on humans not to make systematically.
Re:Using AI to match human performance in translating news f... by foldr on Thursday March 15, 2018 @12:46PM (#16594410)
(outside edit window. first sentence should be 'I eat soup' not 'I like soup')
Re:Using AI to match human performance in translating news f... by foldr on Saturday March 17, 2018 @08:10AM (#16606618)
Hmm, that seems to have been fixed now. Here's a nastier case that shows a similar effect. (Nastier because the agreeing indirect object in Spanish is a subject in English.)

    Which boys does she know like cheese?
    ->
    ¿A qué chicos sabe que LE gusta el queso? [Should be LES]
Re:Using AI to match human performance in translating news f... by echevil on Thursday March 15, 2018 @02:22PM (#16595291)
AI researchers are certainly fully aware of such issues, and there have been various models trying to encode long term dependency information, e.g. LSTM.