News for hackers. Stuff that matters.
Re:Why is GPT-3 15.77x more expensive for certain languages? by explaininjs on Monday April 10, 2023 @02:20PM (#35515494)
Eh… “la mesa” is “the table”, English wins. Even in context, spanish conjunction rules allow you to elide pronouns in many cases that would be confusing in english.

The reason spanish might encode longer is the tokenization scheme compacts tokens based on popularity in training data, and most training data was english. No more no less.

There are no comments on this comment yet.