News for hackers. Stuff that matters.
Re:OpenAI Major Outage by lossolo on Wednesday January 25, 2023 @11:58PM (#34527827)
You meant 700 GB? 32 bit precision in 175B model is around ~700GB + overhead or around 350 GB if they use half-precision.
Re:OpenAI Major Outage by motoboi on Thursday January 26, 2023 @08:56PM (#34541531)
I was wrong. It seems they use fall precision. So 350gb.

What is amazing, human language (languages?) and knowledge encoded in so little space.