News for hackers. Stuff that matters.
Re:Why is GPT-3 15.77x more expensive for certain languages? by minimaxir on Monday April 10, 2023 @03:17PM (#35516206)
A larger vocab takes longer to train but has no (practical) impact at inference time as an Embeddings index is just a key-value store, which is very helpful as GPT starts hitting scaling laws.

There are no comments on this comment yet.