Re:Cerebras and G42 Unveil Condor Galaxy 1, a 4 ExaFLOPS AI ...
by cs-fan-101 on Thursday July 20, 2023 @09:27AM
(#36800111)
[Cerebras employee here] Condor Galaxy 1 can support beyond 600 billion parameters. In standard config its 600B but it can scale to train upwards of 100T parameter models
That's fascinating. Their website[0] says that their model support is 600 billion parameters. Is that enough, given how rapidly these models seem to be expanding? I'm not on the up-and-up with how vast they need to be.
[0] https://www.condorgalaxy.ai/