News for hackers. Stuff that matters.

A comment on M2 Ultra can run 128 streams of Llama 2 7B in parallel. Parent comment

Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel by cyberge99 on Wednesday October 11, 2023 @06:06PM (#37850903)
There’s also MacStadium.
[ Parent | on HN ]
Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel by detourdog on Wednesday October 11, 2023 @06:19PM (#37851052)
I have a fiber connection, the space and the experience to run a Mac mini colo. If people are really interested. I would want to do it as a co-operative that helps with the expense of the physical location.
[ Parent | on HN ]
Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel by ruph123 on Wednesday October 11, 2023 @07:56PM (#37851911)
MacMiniColo and MacStadium merged afaik.
[ Parent | on HN ]