News for hackers. Stuff that matters.

A comment on Kyutai AI research lab with a $330M budget that will make everything open source. Parent comment

Re:Kyutai AI research lab with a $330M budget that will make... by gentleman11 on Sunday November 19, 2023 @10:21AM (#38333428)
Sorry, could somebody show a source for that? An $11M bill, that’s nuts and just need a reference lol
[ Parent | on HN ]
Re:Kyutai AI research lab with a $330M budget that will make... by snypher on Sunday November 19, 2023 @07:40PM (#38340518)
"But to put things into perspective, GPT-3 175B model required 3.14E23 FLOPS of computing for training. Even at theoretical 28 TFLOPS for V100 and lowest 3 year reserved cloud pricing we could find, this will take 355 GPU-years and cost $4.6M for a single training run."

https://lambdalabs.com/blog/demystifying-gpt-3/

[ Parent | on HN ]