Cerebras’ new monster AI chip adds 1.4T transistors

Re:Cerebras’ new monster AI chip adds 1.4T transistors by sillysaurusx on Thursday April 22, 2021 @07:06PM (#26909211)

I’ve learned to be skeptical of such claims. TPUs made that same claim, but it’s hard to use it for real work, since you don’t have access to the 300GB TPU host memory / cpu, where you infeed training examples.

There is a very specific test for “supports pytorch / tendorflow”: show an MLPerf imagenet resnet benchmark. It’s impossible to fake that. If you come anywhere close to TPUs in tensorflow, people (like me) will leap: https://mlcommons.org/en/training-normal-06/

Till then, it’s a “proof, please” type of situation.

[ Parent | on HN ]

Re:Cerebras’ new monster AI chip adds 1.4T transistors by sanxiyn on Thursday April 22, 2021 @08:40PM (#26909806)

I agree.

I have high hope for Graphcore. They stated "We will be participating in MLPerf in 2021, starting with the first training submission in the spring".

https://www.graphcore.ai/posts/graphcore-sets-new-ai-perform...

(I would ignore all benchmarks in that post except the sentence quoted above however.)

[ Parent | on HN ]

Re:Cerebras’ new monster AI chip adds 1.4T transistors by algo_trader on Friday April 23, 2021 @08:46AM (#26914169)

Software will lag new hardware. Duh. The question is whether this is solvable (given a couple of master devs)

Cerebras itself commented that DL is not their first use case. They mentioned fluid dynamics instead. (I can find the reference if someone is interested).

Cerebras also has a weird memory/compute ratio, so very hard for some uses.

Somewhat off-topic. If u have standard keras/TF training code, the GPU to TPU is a smooth-ish transition. No?

A re-write will squeeze another 20% but not 200%?

[ Parent | on HN ]