Re:Natural Language Processing for the Working Programmer
by jasonjei on Monday November 15, 2010 @10:16PM
(#1908866)
It's interesting to note that a lot of natural language processing is English-centered. It's clear that English natural language processing is way ahead of the curve, but based on the quality of Chinese results on Google Translate, I take it Asian languages don't do so hot when it comes to natural language processing?
[ Parent
| on HN ]
Re:Natural Language Processing for the Working Programmer
by syllogism on Tuesday November 16, 2010 @02:15AM
(#1909383)
Translation is a lot harder for language pairs that are less related. Most of the European languages are fairly close cousins, so translation between, say, English and French isn't that hard.
That said, it's generally true that for most NLP tasks, we're doing much better on languages similar to English.
Re:Natural Language Processing for the Working Programmer
by brettbender on Tuesday November 16, 2010 @12:01AM
(#1909112)
Also note that translation is a very different task than parsing, or part-of-speech tagging, for example. Summarization and translation are both open research topics in NLP from what I understand, and aren't really 'solved' in any language.
Re:Natural Language Processing for the Working Programmer
by _corbett on Tuesday November 16, 2010 @08:23AM
(#1909958)
translation is also a lot harder for data poor pairs of languages. machine translation relies on training on a parallel corpus (=same text, different languages), and gets better the bigger this is.