Re:How to make LLMs go fast
by tome on Saturday December 23, 2023 @02:59AM
(#38742484)
Thanks, looks like you're right and this demo is running on 9 GroqRacks (576 chips). I think we may also have an 8 rack version in progress. We've tried a variety of different configurations to improve performance, which is possible because of the high level of flexibility and configurability of our architecture and compiler tool chain.
[ Parent
| on HN ]
There are no comments on this comment yet.