News for hackers. Stuff that matters.

A comment on Why Deep Learning Cannot Be Applied to Natural Languages Easily. Parent comment

Re:Why Deep Learning Cannot Be Applied to Natural Languages ... by ma2rten on Monday January 02, 2017 @09:20PM (#13306159)
Every translation is done by a single human... I would assume they used professional translators, otherwise it's not a fair comparison.

To honest it works better than I thought for French > English, but I when I tried some random French websites (not news) the results were not as good as this example and nowhere near human translations.

[ Parent | on HN ]
Re:Why Deep Learning Cannot Be Applied to Natural Languages ... by nl on Monday January 02, 2017 @09:29PM (#13306200)
Every translation is done by a single human

No, the "perfect score" is an "averaged" translation by multiple humans, measured by BLEU score.

[ Parent | on HN ]
Re:Why Deep Learning Cannot Be Applied to Natural Languages ... by ma2rten on Monday January 02, 2017 @09:57PM (#13306332)
No, they asked humans to rate translation quality from 0 to 6. See section 8.2 of the paper.
[ Parent | on HN ]
Re:Why Deep Learning Cannot Be Applied to Natural Languages ... by nl on Monday January 02, 2017 @10:12PM (#13306399)
Oh, you are right, sorry. I'm confusing it with a different paper.
[ Parent | on HN ]