Re:Groq runs Mixtral 8x7B-32k with 500 T/s
by dkhudia on Monday February 19, 2024 @10:49AM
(#39431052)
@tome for the deterministic system, what if the timing for one chip/part is off due to manufacturing/environmental factors (e.g., temperature) ? How does the system handle this?
[ Parent
| on HN ]
We know the maximum possible clock drift and so we know when we need to do a resynchronisation to keep all the chips in sync. You can read about it in section 3.3 of our recent whitepaper: https://wow.groq.com/wp-content/uploads/2023/05/GroqISCAPape...
Re:Groq runs Mixtral 8x7B-32k with 500 T/s
by mechagodzilla on Monday February 19, 2024 @10:54AM
(#39431113)
Those sorts of issues are part of timing analysis for a chip, but once a chip's clock rate is set, they don't really factor in unless there is some kind of dynamic voltage/frequency scaling scheme going on. This chip probably does not do any of that and just uses a fixed frequency, so timing is perfectly predictable.