News for hackers. Stuff that matters.
Re:Mesh LLM: distributed AI computing on iroh by embedding-shape on Sunday July 12, 2026 @05:17AM (#48879620)
> because they feature 800Gbps of memory bandwidth. About twice what's available on the top end of M5

Ouch, about half of the memory bandwidth of a dedicated GPU though :/ Running LLMs on Apple hardware still doesn't make any sense to me.

There are no comments on this comment yet.