News for hackers. Stuff that matters.

A comment on M2 Ultra can run 128 streams of Llama 2 7B in parallel. Parent comment

Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel by j45 on Thursday October 12, 2023 @10:44AM (#37857901)
The M1 Max and M2 Max are quite serviceable too in not jumping to an ultra.
[ Parent | on HN ]

There are no comments on this comment yet.