Re:How Meta trains large language models at scale
by mhandley on Thursday June 13, 2024 @06:58AM
(#40668064)
On the other hand, Meta just rapidly built two different training networks in existing datacenter buildings, with existing cooling constraints, using mostly commodity components (albeit expensive commodity components) each of which would place at #3 on that top500 list in terms of GPU power. Compare that with how long it took to get any of the other supercomputers from design to being fully commissioned.
[ Parent
| on HN ]
There are no comments on this comment yet.