Re:Why is GPT-3 15.77x more expensive for certain languages?
by minimaxir on Monday April 10, 2023 @03:17PM
(#35516206)
A larger vocab takes longer to train but has no (practical) impact at inference time as an Embeddings index is just a key-value store, which is very helpful as GPT starts hitting scaling laws.
[ Parent
| on HN ]
There are no comments on this comment yet.