News for hackers. Stuff that matters.

A comment on M2 Ultra can run 128 streams of Llama 2 7B in parallel. Parent comment

Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel by throwaway2990 on Wednesday October 11, 2023 @09:10PM (#37852353)
Anyone who thinks the blanket statement “cloud is expensive” really doesn’t know what they are talking about.
[ Parent | on HN ]

There are no comments on this comment yet.