Re:Does Machine Translation Affect International Trade?
by MiroF on Monday September 28, 2020 @11:54AM
(#24617991)
You're absolutely right with your impression of GPT/these models - they will generally generate plausible text.
And it is also worth noting (as you've sort of mentioned) that appearance of fluency can bias translators who are instructed to just evaluate accuracy, or to evaluate accuracy and fluency separately. There is ongoing research into that problem.
Before, I could skim outputs, and get a fair idea of which areas were poorly translated by where it was garbage. Now, I get the impression that (like with GPT or style transfer) something always comes out, whether it's related (or even necessarily has the right negation parity) or not.