Well, the really ironic part of it is that the machine learning models using transformers were literally conceived for converting between languages. So this would be quite the valid use case. Unfortunately, it makes the name more confusing.