Re:Cerebras Inference now 3x faster: Llama3.1-70B breaks 2,1...
by anon291 on Friday October 25, 2024 @02:13AM
(#41942673)
Ex-cereberas engineer here. The chip is very powerful and there is no 'one way' to do things. Rearchitecting data flow, changing up data layout, etc can lead to significant performance improvements. That's just my informed speculation. There's likely more perf somewhere
[ Parent
| on HN ]
There are no comments on this comment yet.