News for hackers. Stuff that matters.

A comment on M2 Ultra can run 128 streams of Llama 2 7B in parallel. Parent comment

Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel by ClimaxGravely on Wednesday October 11, 2023 @10:08PM (#37852697)
I hate to say this but it has gotten to the point where I'm starting to farm some of my own food (I'm starting to get fed up with produce quality issues in my hometown).

Still haven't started on the silverware or shoes yet.

I do agree with you though. If you are a non-tech company or a company that lacks the human resources you might as well go with the cloud.

[ Parent | on HN ]
Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel by solardev on Thursday October 12, 2023 @01:58AM (#37853893)
That's not anything to be ashamed of. It's awesome you grow your own food!
[ Parent | on HN ]