News for hackers. Stuff that matters.
Re:Does Machine Translation Affect International Trade? by dwohnitmok on Sunday September 27, 2020 @09:15PM (#24611877)
> My experience with the former is that the MT is far from perfect, and even frequently causes much amusement, but definitely useful.

Oh fascinating, do you have any idea of what things machine translation still consistently gets wrong?

Re:Does Machine Translation Affect International Trade? by klodolph on Sunday September 27, 2020 @10:08PM (#24612249)
Oh, so much. Machine translation doesn't understand context and routinely fails at fairly basic translation tasks.

Here's part of the Google translation of the front page of ja.wikipedia.org into English:

> 非行少年の再非行の抑止や更生を目的としており、決定までの過程として、「非行事実を家庭裁判所に送致・通告 - 家庭裁判所調査官(以下「調査官」と略称する)等による調査 - 調査結果をふまえた審判 - 必要に応じて保護的措置あるいは保護処分を決定」という流れを経るのが通例である。

> And for the purpose of deterrence and rehabilitation of re-delinquency of juvenile delinquents, as the process of until a decision, " the fact delinquency to the family court -up Reel-notice - family court investigators (referred to hereinafter as" investigators "), or the like by the survey - survey It is customary to go through the flow of " judgment based on the result- decide protective measures or protective measures as necessary ".

That's barely recognizable as English. The translation is hot garbage. Perhaps something you might use if you had an emergency.

Just to point out here... the text on the front page of Wikipedia tends to be very neutral, matter-of-fact, and well written. There are no characters (like in novels), no use of slang, and nothing else that should be tricky for translation, and yet we get this garbage.

It's a miracle that machine translation works at all, and when it does work, it is usually because you are translating between languages that are fairly similar to begin with. For example, English and Spanish.

Re:Does Machine Translation Affect International Trade? by getoj on Monday September 28, 2020 @12:01AM (#24612840)
For anyone interested in a correct translation, the Japanese reads:

"Its purpose is recidivism prevention and rehabilitation for youth offenders; the usual process leading up to a decision is: Notice or report of the fact of the youth crime to the family court > Investigation by the family court investigating officer (the "Investigator") and/or other parties > Judgment based on the results of the investigation > Protective measures or a disposition for rehabilitation, as necessary."

>Just to point out here... the text on the front page of Wikipedia tends to be very neutral, matter-of-fact, and well written

This is true in general, though perhaps not always of Japanese wikipedia, and certainly not on legal topics. I have no love lost with machine translation (hard agree on naniwaduni's comment about "insidious failure modes"), but there are very few humans who would be able to translate this particular excerpt effectively. Legal translation is my job and I still found this sentence to be reasonably challenging.

Re:Does Machine Translation Affect International Trade? by benrbray on Sunday September 27, 2020 @11:08PM (#24612593)
Yeah, Google Translate is hot garbage when it comes to Japanese. DeepL does quite a good job though!

> The purpose of this process is to deter and rehabilitate the juvenile delinquent, and the process of making a decision on the delinquency is usually conducted in the following manner: referral and notification of the fact of the delinquency to the family court; investigation by an investigator of the family court (hereinafter referred to as "investigator"); trial based on the results of the investigation; and, if necessary, a decision on protective measures or protective measures. There is.

Translated with www.DeepL.com/Translator (free version)

Re:Does Machine Translation Affect International Trade? by naniwaduni on Sunday September 27, 2020 @11:23PM (#24612663)
Right from the start, DeepL manages to drop information, making it seem as if it's describing a program that deters juvenile delinquency.

DeepL is doing a better job of generating text that seems to make sense, but this just helps to more effectively communicate the wrong meaning, and in a manner less detectable to people who would use it. This is a much more insidious failure mode.

Re:Does Machine Translation Affect International Trade? by thaumasiotes on Monday September 28, 2020 @06:12AM (#24615009)
> DeepL is doing a better job of generating text that seems to make sense, but this just helps to more effectively communicate the wrong meaning, and in a manner less detectable to people who would use it. This is a much more insidious failure mode.

This is something I don't understand about the use of autocorrect. Autocorrect takes misspelled words, which are essentially always easy to understand, and replaces them with random other words. It's frequently impossible to guess what original word got mangled by autocorrect into appearing in a suddenly unintelligible sentence. This is a problem that misspellings just don't have.

Autocorrect is actively making communication worse. What's it supposed to be doing? Why is it there at all?

Re:Does Machine Translation Affect International Trade? by rocqua on Monday September 28, 2020 @07:54AM (#24615634)
Fully automatic autocorrect is very different from optional (i.e. user prompted) autocorrect.

The first has your stated effect. The second does not.

Re:Does Machine Translation Affect International Trade? by CarVac on Monday September 28, 2020 @08:21AM (#24615817)
User-prompted autocorrect isn't "auto" at all, it's spell-check.
Re:Does Machine Translation Affect International Trade? by rocqua on Monday September 28, 2020 @08:56AM (#24616118)
As I type on my phone it auto-guesses the word. I can choose to pick the guessed word, and almost always do so. I call that a lot more than spell-check and yet no words that I did not actively choose sneak in.
Re:Does Machine Translation Affect International Trade? by thaumasiotes on Monday September 28, 2020 @09:07AM (#24616212)
You aren't using autocorrect. You're using predictive input.
Re:Does Machine Translation Affect International Trade? by fireattack on Monday September 28, 2020 @01:22AM (#24613238)
DeepL.com's JPN->ENG is better than Google Translate most of times, but still far from usable.

Also, it has "bugs" that sometimes it will just drop an entire sentence or half-sentence for no reason.

Re:Does Machine Translation Affect International Trade? by _-___________-_ on Monday September 28, 2020 @12:40AM (#24613029)
That's an even worse job than Google Translate did.
Re:Does Machine Translation Affect International Trade? by _-___________-_ on Monday September 28, 2020 @12:39AM (#24613025)
Admittedly I am usually translating English and east Asian languages, like this example, but I've basically given up on Google Translate (and other machine translation) at this point. It's worse than useless, because it often produces a translation that reads like it could be correct, but has the meaning reversed or otherwise garbled.
Re:Does Machine Translation Affect International Trade? by MiroF on Monday September 28, 2020 @12:04PM (#24618116)
Uhhh.. I just translated the exact same sentence from wikipedia in Google translate and got:

"The juvenile protection procedure aims to deter and rehabilitate juvenile delinquents, and as a process up to the decision, "send and notify the facts of delinquency to the family court-family court investigator (hereinafter abbreviated as" investigator "). It is customary to go through the flow of "investigation by, etc.-a referee based on the investigation results-determine protective measures or protective measures as necessary"."

Not incredible (especially when it starts listing the process), but not as god awful as whatever you got. I'm curious if you omitted some part of the sentence when pasting in.

It's also worth noting that this is a pretty out-of-domain legal Japanese sentence.

Re:Does Machine Translation Affect International Trade? by nonbirithm on Sunday September 27, 2020 @11:07PM (#24612586)
One issue with Japanese specifically is that the subject is often omitted from the sentence and inferred from context. It's less common to see the equivalent pronouns of "I" or "they" in Japanese, but it's required a lot more in English. A machine translation would have to determine what pronoun to use when there isn't one in the original sentence to go off of, which is hard.

Then there are other things besides pronouns that require inference. For example, adding な to the end of a sentence could mean either a modifier expressing admiration or confirmation, or it could be indicate a demand or order not to do something. In machine translation it almost always seems to be translated to "don't" no matter the context. That only makes the translation less accurate.

Re:Does Machine Translation Affect International Trade? by hrktb on Monday September 28, 2020 @01:43AM (#24613326)
I get the feeling that pronouns are also not explicit in Chinese most of the time, making it as hard to properly translate in english.

And I’d assume that could be the most common language people would want to translate from online platforms in this day and age.

Re:Does Machine Translation Affect International Trade? by yorwba on Monday September 28, 2020 @03:33AM (#24613971)
The most common language people would want to translate from online platforms is most likely English, given it's ubiquitous use on the internet and the fact that there are more people who don't speak English than people who do.

Of course the details of how English is turned into incomprehensible garbage by machine translation always depend on the target language in question.

Re:Does Machine Translation Affect International Trade? by fireattack on Monday September 28, 2020 @02:57AM (#24613713)
It's not nearly as bad compared to Japanese. And it pretty much only happens in conversations.
Re:Does Machine Translation Affect International Trade? by DelightOne on Monday September 28, 2020 @06:40AM (#24615201)
How are models trained for this, maybe Ja->En->Ja and see how the the result differs from the input?
Re:Does Machine Translation Affect International Trade? by qayxc on Monday September 28, 2020 @09:06AM (#24616207)
> do you have any idea of what things machine translation still consistently gets wrong?

My biggest pet peeve with MT is the incredibly brain-dead choice of using English as an intermediate language.

This effectively prevents MT from ever becoming useful for any A→B translation where neither A nor B are English.

Example: put "пружи́на" into Google translate (or Bing translate, doesn't matter)and translate to German. You'll get "Frühling" as the suggested translation.

This is due to the fact that internally "пружи́на" is translated to English first, resulting in "spring". This is then translated to German with the statistically highest probability being "Frühling", even though "Feder" would be the only correct match ("Frühling" would be "весна" in Russian).

If you now say "But wait! This should clear itself up once you add some context, right?" you'd be wrong.

Try "Die Sprungfeder kam gerade rechtzeitig." ("The coil spring arrived just in time,") and you'll get "Весна пришла как раз вовремя." ("Springtime came just in time").

It's ridiculous!

EDIT: happens with DeepL as well; only Yandex gets it right (presumably because they actually use an actual German/Russian-model.

Re:Does Machine Translation Affect International Trade? by MiroF on Monday September 28, 2020 @11:58AM (#24618049)
> This is due to the fact that internally "пружи́на" is translated to English first, resulting in "spring"

Do you have a source that that is actually what is happening behind the scenes? I work in this field and would be surprised if that is what Google is doing. My guess is this phenomenon is more due to a model that was trained on an Russian->English corpora first and then trained on Russian->German due to low resource, or something like that.

Someone like Yandex is going to have better translations because (shocker) they have larger russian corpora than google.

Re:Does Machine Translation Affect International Trade? by qayxc on Monday September 28, 2020 @01:04PM (#24618819)
> Do you have a source that that is actually what is happening behind the scenes?

Indirectly yes, I do: https://codesachin.wordpress.com/2017/01/18/understanding-th...

> What this basically means is: If during training you provide it examples of English->Japanese & English->Korean translations, GNMT automatically does Japanese->Korean reasonably well! In fact, this is the biggest achievement of GNMT as a project.

It's exactly what Google have been doing for years now: train on X-to-English and English-to-Y only to get X-to-Y for free. Since the intermediate language only ever sees English as a source or target language, ambiguities like "spring" literally get lost in translation.

Re:Does Machine Translation Affect International Trade? by MiroF on Monday September 28, 2020 @01:09PM (#24618877)
Just gave that a read.

1. It is pretty out of date (ML is a fast moving field) - I doubt Google is using LSTMs for translation in 2020.

> Since the intermediate language only ever sees English as a source or target language, ambiguities like "spring" literally get lost in translation.

2. This article is trying to dumb down what Google is doing - but you're right that this is why ambiguities get lost in translation, due to pre-training on a different language pair.

That said, there isn't literally a process of "translate into english" and then "translate english into german". These models are trained on Russian-German corpora, but because there is little resources for that, they are supplementing with Russian-English and English-German.

Re:Does Machine Translation Affect International Trade? by qayxc on Monday September 28, 2020 @02:51PM (#24620024)
> It is pretty out of date (ML is a fast moving field) - I doubt Google is using LSTMs for translation in 2020.

Sure, but that doesn't change the fact the training data is focused on English-to-X and X-to-English corpora. The underlying architecture of the model is just an implementation detail that doesn't really affect this as demonstrated by my example.

> These models are trained on Russian-German corpora, but because there is little resources for that, they are supplementing with Russian-English and English-German.

This is exactly what I'd argue isn't the case at all. Otherwise words that have a direct 1:1 translation wouldn't be mistranslated and companies like Yandex wouldn't be able to deliver so much better results.

German-Russian isn't low-resource at all, given 95M and 150M native speakers respectively and a close history for the past 150 years. [edit]The rich cultural history of both countries resulting in a vast library of literature, theatre plays, news publications, films and the general cultural relevance of both languages is even more important.[/edit] It's simply (quite comprehensible) bias towards English for research taking place in the USA and the fact that it's much easier to compile English-to-X and X-to-English corpora in a predominantly English-speaking country.

There are tons of translated books, films, news paper articles, scientific papers, etc. available for Russian-German and Yandex, being a Russian company, naturally has no problem compiling a Russian-German corpus (since they're not biased towards English).

Re:Does Machine Translation Affect International Trade? by Shorel on Monday September 28, 2020 @02:38PM (#24619901)
Whatever the actual reason is, the results feel like English is used as an intermediate.

This also happens between e.g. Spanish and Bulgarian.

Re:Does Machine Translation Affect International Trade? by dmurray on Monday September 28, 2020 @09:29AM (#24616407)
It's not brain-dead, it's a result of limited training data.

For N languages you need to train N models if you go through English as an intermediate language, but N^2 if you don't use an intermediate language model. OK, computer time is cheap these days, but more importantly, for each language pair you need D high-quality documents translated in each of your two languages.

There are far fewer pieces of writing that exist in both German and Russian than in both German and English or both Russian and English.

There is cool-looking research on zero-shot language translation where the model learns its own internal "intermediate language". But you can be sure that if it produced reliably better results with the data available, the likes of Google would already be using it.

Re:Does Machine Translation Affect International Trade? by qayxc on Monday September 28, 2020 @10:05AM (#24616702)
> It's not brain-dead, it's a result of limited training data.

That's quite literally a cheap excuse. It'snot lack of training data (remember, you still need translations in the target language anyway!), it's a result of Anglo-Saxon cultural hegemony.

> There are far fewer pieces of writing that exist in both German and Russian than in both German and English or both Russian and English.

Right. And that's why Russia-based Yandex gets excellent results for German/Russian translation, I see...

> But you can be sure that if it produced reliably better results with the data available, the likes of Google would already be using it.

Nah, you're being way too optimistic there. Google is a business and as such, they don't chase SOTA outside of research (which doubles as advertisement). Good enough is the name of the game and it's simply infinitely cheaper to just train and maintain N-models (i.e. English/X and X/English) than to do the same for all combinations of X/Y-pairs (which would be N² models).

So as long as there is no incentive to do better, they simply won't, because they rely on the fact that English is the de-facto Lingua Franca and people translate to and from English more often than directly between other languages.

This would be an actual chance for companies from other countries (especially European ones) to step in and do exactly that, but again - "good enough" and reliance on English stops that from happening anytime soon. It's a missed opportunity especially with low-resource languages as demonstrated by the recent "Scottish" Wikipedia fiasco...

Re:Does Machine Translation Affect International Trade? by Shorel on Monday September 28, 2020 @02:36PM (#24619884)
> Oh fascinating, do you have any idea of what things machine translation still consistently gets wrong?

Definitely anything where a word has two or more different meanings.

Paper jam being my favourite example.

https://translate.google.com/#view=home&op=translate&sl=en&t...

It is translated as "(fruit) jam made out of paper"

Re:Does Machine Translation Affect International Trade? by _jahh on Sunday September 27, 2020 @09:19PM (#24611900)
not op but i find idiom or proper nouns can mess things up.
Re:Does Machine Translation Affect International Trade? by Polylactic_acid on Monday September 28, 2020 @02:10AM (#24613460)
Another one is when one language uses a single word for two meanings which the other language has split. An example I cam across is when I translated the word "amber" meaning the orange color and the translation came out the other end as a word that purely means "fossilized sap"
Re:Does Machine Translation Affect International Trade? by 082349872349872 on Monday September 28, 2020 @02:28AM (#24613565)
I generally learn proper nouns first (following news is my biggest use of MT) and I've found it often helps to replace them by placeholders such as X and Y when translating.

As to sibling comment, IIRC Yandex translate has a nice feature where they'll provide a number of meanings for words when clicked upon in the source text.

"Invisible, Insane"