Re:Why is GPT-3 15.77x more expensive for certain languages?
by JCharante on Monday April 10, 2023 @02:47PM
(#35515855)
but training against the entire Internet would still be biased towards English because English is the dominant language used on the Internet.
Re:Why is GPT-3 15.77x more expensive for certain languages?
by MichaelZuo on Monday April 10, 2023 @05:09PM
(#35517434)
> Everyone has to choose what data to train on, you can't train against The Entire Internet, it's a limitless amount of data.
Isn't that exactly how OpenAI managed to 10x GPT 3.5 with GPT 4.0?
Everyone has to choose what data to train on, you can't train against The Entire Internet, it's a limitless amount of data. But it becomes an intentional choice with consequences, like the 15.77x seen here.