Re:Why is GPT-3 15.77x more expensive for certain languages?
by Vecr on Monday April 10, 2023 @03:06PM
(#35516069)
That might not be true. OpenAI do set a limit of the total number of tokens, and since I'm pretty sure they trained the model and the tokenizer on mostly English text, I assume there's a somewhat proportional bias toward English based on the input dataset to those models.
[ Parent
| on HN ]
There are no comments on this comment yet.