News for hackers. Stuff that matters.
Re:No Language Left Behind by Etheryte on Wednesday July 06, 2022 @05:17PM (#32006940)
I'll believe it when I actually see it. I'm a native of a reasonably small language spoken by about a million people and never have I ever seen a good automatic translation for it. The only translations that are good are the ones that have been manually entered, and those that match the structure of the manually entered ones. I think the sentiment is laudable and wish godspeed to the people working on this, but for the time being I don't see it becoming a reality yet. When Google Translate regularly struggles even with big pairs such as German-English-German, I have reservations about someone making it work for languages where datasets are orders of magnitude smaller.
Re:No Language Left Behind by hello_im_angela on Wednesday July 06, 2022 @05:25PM (#32007019)
It's an extremely difficult problem indeed. A lot of people on the team speak low-resource languages too (my native language as well!), so definitely resonate with what you're saying. My overall feeling is: yeah it's hard, and after decades we can't even do German translation perfectly. But if we don't work on it, it's not gonna happen. I really hope that people who are excited about technology for more languages can use what we've open sourced.
Re:No Language Left Behind by azinman2 on Wednesday July 06, 2022 @06:31PM (#32007721)
> But if we don't work on it, it's not gonna happen.

That’s exactly right. There’s too much bias in society that if something isn’t perfect, then why bother? Nothing is perfect, so with that attitude there can be no progress. Thank you for doing important work!

Re:No Language Left Behind by Gigachad on Thursday July 07, 2022 @01:14AM (#32010157)
Personally I'm hoping that globalisation prunes out as many languages as possible before we end up with brain implants automatically translating everything for us and no one can communicate without these chips.
Re:No Language Left Behind by pegasus on Thursday July 07, 2022 @07:43AM (#32012728)
That's a silly thing to wish for: like wishing global warming kills off as many species of animals as possible, in order to simplify zoology.
Re:No Language Left Behind by pmontra on Thursday July 07, 2022 @02:38AM (#32010642)
Becoming bilingual is one thing. Completely extinguishing a language is a totally different matter. It is usually associated with migrating away from the geographic area of the language and/or physically losing speakers (old age, wars, genocides, etc.)

You can check the list at https://en.wikipedia.org/wiki/List_of_languages_by_time_of_e...

To make an example and be blunt: I do not expect any European country official language to get extinct anytime during our lifespan unless that country gets destroyed, which obviously won't be a good thing.

As for brain implants, I won't hold my breath.

Re:No Language Left Behind by cyphar on Thursday July 07, 2022 @03:44AM (#32011013)
There are several reasons a language can go extinct, and while the reasons you mentioned are included there are several other reasons that you didn't consider. The most common way language death occurs is through contact with a prestige language, which results in social pressure that makes the non-prestige language become less and less commonly spoken[1]. A community becoming bilingual is part of this process -- it doesn't always result in language death, but it is an early stage of that form of language death.

As for a European country official language (strange line to draw), Icelandic is already in a state where younger Icelandic natives speak to each other in English because smartphones do not support their native language. It is entirely possible that Icelandic will be in danger of extinction this century[2].

[1]: https://www.youtube.com/watch?v=t3qbYFvOHwk [2]: https://www.nytimes.com/2017/04/22/world/europe/iceland-icel...

Re:No Language Left Behind by raverbashing on Thursday July 07, 2022 @05:16AM (#32011640)
Icelandic won't disappear soon. (it's a bit of a mistake to say latin disappeared but I digress)

It might take some work (and more media being produced in it, surely) but I don't think it's at risk

> because smartphones do not support their native language

Nowhere in the article says that. And most smartphones do even have support (including the Icelandic keyboard)

what is not supported is voice activated devices:

> "“Not being able to speak Icelandic to voice-activated fridges, interactive robots and similar devices would be yet another lost field,"

Re:No Language Left Behind by cyphar on Thursday July 07, 2022 @07:31PM (#32021053)
(I guess we've skipped over the discussion about whether language death can occur without genocide.)

> it's a bit of a mistake to say latin disappeared but I digress

Latin is a dead language. It's not extinct (because it's used for ceremonial reasons by the Catholic Church) but it has no native speakers. This is not a remotely controversial statement. Old Church Slavonic has a similar role in Slavic Orthodox Churches and is also a dead language for the same reason.

> Nowhere in the article says that. And most smartphones do even have support (including the Icelandic keyboard).

In my defense, I can't read the article -- I linked it because this Tom Scott video[1] uses that article as a reference for the Icelandic example he gave where he explicitly says that Icelandic is not supported by modern smartphones. My phone does have Icelandic support now so I guess the statement was only true at the time he said it?

[1]: https://youtu.be/qYlmFfsyLMo?t=137

Re:No Language Left Behind by raverbashing on Friday July 08, 2022 @04:14AM (#32024237)
Thanks for clarifying

You're of course right about "Latin is dead" (for practical purposes). But there's lots of nuances that get lost in this statement

Latin is dead in the same way as Middle English is dead. The Latin that died is the one around the late Roman Empire time that was "photographed" and frozen in time as Ecclesiastical Latin (oversimplification, of course)

And of course the modern romance languages derived from it, but there's no exact time where those "flipped the switch" and became modern French, Spanish, Catala, Portuguese, etc. So in a way it could be argued that they're Latin 3.0 w/ DLCs (which I'll totally give that it's a big stretch)

Re:No Language Left Behind by yakak on Thursday July 07, 2022 @07:19AM (#32012561)
By your criteria no language that has survived to now will disappear without a major global calamity. Effectively, latin is a not a language for a native speaker that wants to go through their life and leave future native speakers.

Regarding Icelandic, I know little about it except that it has a lot of non-ANSI if written properly. I already know many latin language dialect speakers that developed their behavior when the limits of SMS unicode were significantly smaller than ANSI, with long term repercussions. I'm not sure why facts like that would need to be in the article to discuss here?

Re:No Language Left Behind by mellavora on Thursday July 07, 2022 @03:27AM (#32010911)
So, Ukrainian?
Re:No Language Left Behind by eCa on Thursday July 07, 2022 @03:34AM (#32010953)
> prunes out as many languages as possible

Would you feel the same way if that includes all languages you know, including all versions of English?

Re:No Language Left Behind by Gigachad on Thursday July 07, 2022 @03:45AM (#32011024)
Yes, I’d be happy to learn a new language if it was the step to one unified language. Of course there is no way to back that up since it will never happen but I at least assume I’d do it if that was the case.
Re:No Language Left Behind by cyphar on Thursday July 07, 2022 @07:45PM (#32021177)
Would you not feel even slightly unhappy that your children (or grandchildren) would not be able to read the original versions of Shakespeare, Dickens, or Austen or that they wouldn't be able to watch the original versions of movies and shows you've enjoyed? They would only be able to watch and read translations, and all of the linguistic artistry would be lost to them.

It's not just about becoming bilingual, a population becoming bilingual in a "prestige language" is the first stage of language death (though of course it doesn't /always/ lead to language death).

Re:No Language Left Behind by Gigachad on Friday July 08, 2022 @01:48AM (#32023765)
No not really. English has shifted so far that those works are hardly as understandable now as a modern translated work.
Re:No Language Left Behind by cyphar on Friday July 08, 2022 @08:09AM (#32026102)
That isn't the case for every language, I'm just trying to come up with an equivalent explanation of why wishing for languages to die out is a bad thing.
Re:No Language Left Behind by MrPatan on Thursday July 07, 2022 @06:01AM (#32011942)
How would you feel about being the one that has to teach your children a language that will hinder their prospects instead of one that will help them succeed, just so that the speakers of the bigger language feel good about themselves that they are good people or something?
Re:No Language Left Behind by cyphar on Thursday July 07, 2022 @07:39PM (#32021130)
I could not think of a more obvious way of telling everyone that you are monolingual than implying that knowing another language is a burden. Children are not burdened by being multilingual.

It is true that social pressures kill off local languages, but it's usually not because parents don't want to teach their children their mother tongue, it's that people stop using the language to communicate because of the influence of the "prestige language". My parents (and all of the parents in the immigrant community I live in) went through great pains to teach their children their native language.

Re:No Language Left Behind by MrPatan on Friday July 08, 2022 @06:50AM (#32025412)
English is, of course, my second language, maybe that's why you didn't quite grasp what I was saying.

The burden is not in knowing another language, the burden is in making the "less useful" language your main one.

Your parents and all of the parents in the immigrant community you live in are very happy that English is now your main language which you acquired through school, friends, tv etc. Or maybe they put you in your-language-only schools, made sure you socialized with your-language-only friends and watched your-language-only media?

Re:No Language Left Behind by eCa on Thursday July 07, 2022 @08:29AM (#32013149)
I don’t think I my prospects in any way is hindered by being a native speaker of a fairly small language. If anything, I prefer having English as a second language.

How would you feel if your kids only learned Chinese[1], and not a word of English?

[1] I’m assuming you’re not Chinese

Re:No Language Left Behind by adrianN on Thursday July 07, 2022 @05:43AM (#32011800)
I'm still a bit disappointed that Esperanto isn't the official language of the EU.
Re:No Language Left Behind by yosito on Thursday July 07, 2022 @01:13AM (#32010152)
I speak a medium-resource language with 11 million speakers. Google Translate works so poorly with it that translations are often nonsensical. But DeepL works so well with it that translations are often indistinguishable from native speaking translations. I'm a big believer that the model can make a huge difference.
Re:No Language Left Behind by cyphar on Thursday July 07, 2022 @01:25AM (#32010215)
On the other hand, as a non-native Japanese learner, it is very obvious when Japanese text has been DeepL-translated because it often makes 敬語/register and context mistakes (and translating Japanese to English it does even worse because it struggles with null-subject languages). I am sure a native Japanese speaker would be able to see even more mistakes than I can.
Re:No Language Left Behind by trinix912 on Thursday July 07, 2022 @01:51AM (#32010375)
DeepL seems to handle grammar a bit better (ex. run-on sentences) but for whatever reason, it struggles with basic vocabulary sometimes. Also, when it does make mistakes, they change the meaning subtly enough to render the translation unusable.
Re:No Language Left Behind by jhugo on Thursday July 07, 2022 @02:54AM (#32010716)
Google Translate does the same in many languages, to the point that it will often reverse the meaning of a sentence. I honestly feel like these tools are still mostly useful when you don't really need to know what the text means.
Re:No Language Left Behind by alfiedotwtf on Wednesday July 06, 2022 @09:38PM (#32009016)
> I ever seen a good automatic translation for it. > > When Google Translate regularly struggles even with big pairs such as German-English-German, I have reservations about someone making it work for languages where datasets are orders of magnitude smaller.

I speak a language where I've never seen any translation for it... and when translated manually, my mum totally butchers the meaning lol.

Either way, any work in this area is more than welcome, but damn it's a hard problem.

Re:No Language Left Behind by bobsmooth on Wednesday July 06, 2022 @06:59PM (#32007939)
There's a section where you can try reading translated children's books. See if your language is supported and how good the translation is.
Re:No Language Left Behind by underlines on Thursday July 07, 2022 @04:44AM (#32011430)
Burmese and Cambodian are 100% useless on google/bing translate, but the children books translations on the example page are really, really good.
Re:No Language Left Behind by aeontech on Wednesday July 06, 2022 @11:20PM (#32009572)
Surprisingly, translations of the books into Russian seem considerably better than into English (at least for the first three books I tried)
Re:No Language Left Behind by thriftwy on Thursday July 07, 2022 @06:31AM (#32012211)
There's a large tradition of having texts translated into Russian, whereas English speakers would very rarely read anything translated from another language.
Re:No Language Left Behind by debesyla on Thursday July 07, 2022 @08:18AM (#32013052)
"Tradition" sounds a bit funny knowing that a lot of Russian book publishing was/is published without author permission. Russian publishing isn't well known for following copyright laws :V
Re:No Language Left Behind by thriftwy on Thursday July 07, 2022 @08:54AM (#32013444)
I'm pretty sure that Russian (Soviet?) publishers observed whatever copyright laws there were at the time. It's just that international copyright law is a recent phenomenon. USA is also a very late signatory of international book copyright treaties AFAIK.