Re:Firefox Translations doesn't use the cloud
by m_eiman on Wednesday November 30, 2022 @03:25AM
(#33798296)
FWIW it works on M1 Macs, I suppose they same something equivalent to SSE4.1.
Re:Firefox Translations doesn't use the cloud
by jelmervdl on Wednesday November 30, 2022 @03:56AM
(#33798431)
It is running a full transformer type neural network on your cpu, it needs all the speed it can get.
Itβs because the translation engine requires at least SSSE3.1 instructions[1]. These are translated to wasm SIMD instructions[2] which are only enabled by browsers if the underlying hardware is there to execute these at least somewhat efficient.
[1] https://github.com/browsermt/bergamot-translator/issues/418
Obviously. Replacing text is a huge CPU intensive task.