Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Groq runs Mixtral 8x7B-32k with 500 T/s. Parent comment
You literally can, in fact that’s the entire reason to use multiple chips.
See eg the TPU group’s paper: https://arxiv.org/abs/2211.05102
There are no comments on this comment yet.
You literally can, in fact that’s the entire reason to use multiple chips.
See eg the TPU group’s paper: https://arxiv.org/abs/2211.05102