News for hackers. Stuff that matters.
Re:Whisper – open source speech recognition by OpenAI by TaylorAlexander on Wednesday September 21, 2022 @01:17PM (#32928253)
It seems these days that language-oriented models are commonly becoming multilingual by default. There are a lot of common threads when understanding sentence construction between different languages. French and English have different rules but they will still have things like nouns, adjectives, subjects, prepositions, etc. It seems that by training models on many languages you get both a more robust understanding of language, and it saves you the trouble of having to make many more localized models for every language. I also believe that the other languages help the models construct sentences in languages which have very small training sets. If it has a few examples in a rare language as well as good translations to a better-known language, then it can provide good support for the rare language.

We also see in image generation models that multi-modal networks are more powerful than single purpose networks. As we move towards more advanced AI systems I suspect we will see more and more generalizable networks with distinct advantages over separate networks that get plugged together.

Re:Whisper – open source speech recognition by OpenAI by magicalhippo on Wednesday September 21, 2022 @02:24PM (#32929155)
Would a multilingual modal perhaps also be better at understanding non-natives speech?
Re:Whisper – open source speech recognition by OpenAI by TaylorAlexander on Wednesday September 21, 2022 @08:57PM (#32933612)
Good question but I don’t know the answer.