Re:Cerebras Wafer Scale Engine Gen2 7nm 2.6T Transistors
by trhway on Wednesday August 19, 2020 @02:42AM
(#24207818)
by transistor count, by energy consumption and i'd expect by the price it is an equivalent of 3 x 16 V100 DGX/Lambdasystems. Can it beat such a minicluster? Vertical vs. horizontal scaling seems to be still an open question for DL. It looks like the horizontal - ie. V100 approach in this case - would naturally have advantage over the vertical when it comes to sheer scale, i.e. like the maximum possible size of model.
[ Parent
| on HN ]
There are no comments on this comment yet.