News for hackers. Stuff that matters.

A comment on M2 Ultra can run 128 streams of Llama 2 7B in parallel. Parent comment

Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel by benreesman on Thursday October 12, 2023 @02:31AM (#37854092)
People like vast.ai are making moves in this geberal direction FWIW if you’re passionate about it.
[ Parent | on HN ]

There are no comments on this comment yet.