News for hackers. Stuff that matters.
Re:How to make LLMs go fast by tome on Saturday December 23, 2023 @02:59AM (#38742484)
Thanks, looks like you're right and this demo is running on 9 GroqRacks (576 chips). I think we may also have an 8 rack version in progress. We've tried a variety of different configurations to improve performance, which is possible because of the high level of flexibility and configurability of our architecture and compiler tool chain.

There are no comments on this comment yet.