News for hackers. Stuff that matters.
Re:Google Translate might not be as good as people thought by user24 on Thursday September 23, 2010 @11:17AM (#1719912)
Most SMT systems are trained using the procedings of the European Court - as it's a huge corpus of multilingual documents which all have the same meanings.

This is a large factor as to why non-european languages typically don't fare that well in Statistical Machine Translation systems. The corpuses (corpii?) aren't as large for other languages.

Subject-broadness is another problem. Early information retrieval systems were trained (and many still are) using the Wall Street Journal as the corpus. Which means they work great for searching on the topic of big business, but not so great on getting apple pie recipes, as WSJ doesn't talk much about that ;)

Re:Google Translate might not be as good as people thought by woodson on Friday September 24, 2010 @10:45AM (#1723780)
There are some research projects (in rather early stages) that develop SMT techniques for translation to languages without big parallel corpora (essentially by bootstrapping such corpora, assisted by active learning). This could be of particular importance to keep smaller languages from disappearing, otherwise less and less works in that language will be available (yes, I'm aware that there are many people who consider language death a good thing).
Re:Google Translate might not be as good as people thought by user24 on Saturday September 25, 2010 @06:33AM (#1726710)
Sounds fascinating; links? research? Applicability to lost languages like Linear A?
Re:Google Translate might not be as good as people thought by crux on Thursday September 23, 2010 @12:43PM (#1720255)
'(corpii?)'

corpores, if you must.

Re:Google Translate might not be as good as people thought by rudd on Thursday September 23, 2010 @01:01PM (#1720320)
The plural of corpus is 'corpora': http://en.wikipedia.org/wiki/Text_corpus
Re:Google Translate might not be as good as people thought by user24 on Thursday September 23, 2010 @07:03PM (#1721905)
slaps forehead of course it is! Thanks :)