News for hackers. Stuff that matters.
Re:Mozilla releases local machine translation tools as part ... by maxloh on Thursday June 02, 2022 @04:23PM (#31600056)
What is the dataset used for training the model? Where did the data come from?
Re:Mozilla releases local machine translation tools as part ... by jelmervdl on Thursday June 02, 2022 @04:41PM (#31600242)
All of them are freely available. Most of them through mtdata [1]. The exact list of the datasets is in the firefox-translations-training pipeline configuration file [2].

[1] https://pypi.org/project/mtdata/

[2] https://github.com/mozilla/firefox-translations-training/blo...