News for hackers. Stuff that matters.
Re:No Language Left Behind by vjerancrnjak on Wednesday July 06, 2022 @05:27PM (#32007039)
What are hardware requirements to run this?

I see the mixture model is ~ 300 GB and was trained on 256 GPUs.

I assume distilled versions can easily be run on one GPU.

Re:No Language Left Behind by hello_im_angela on Wednesday July 06, 2022 @05:31PM (#32007070)
We release several smaller models as well: https://github.com/facebookresearch/fairseq/tree/nllb/exampl... that are 1.3B and 615M parameters. These are usable on smaller GPUs. To create these smaller models but retain good performance, we use knowledge distillation. If you're curious to learn more, we describe the process and results in Section 8.6 of our paper: https://research.facebook.com/publications/no-language-left-...
Re:No Language Left Behind by mdda on Thursday July 07, 2022 @02:20AM (#32010553)
"All models are licensed under CC-BY-NC 4.0" :

So, to clarify, does this mean that companies cannot use these models in the course of business, or is it more about selling the translation results directly?