Re:Meta is inviting researchers to pick apart the flaws in i...
by timmg on Monday June 27, 2022 @02:22PM
(#31898547)
Dumb question: does 175B parameters mean the number of bytes (or floats?) in the model? Does that also mean you need the whole model in memory to do inference (in practice)?
If so, not many machines have that much RAM. Makes it hard to "play" with.
If so, not many machines have that much RAM. Makes it hard to "play" with.