Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Mesh LLM: distributed AI computing on iroh. Parent comment
Ouch, about half of the memory bandwidth of a dedicated GPU though :/ Running LLMs on Apple hardware still doesn't make any sense to me.
There are no comments on this comment yet.
Ouch, about half of the memory bandwidth of a dedicated GPU though :/ Running LLMs on Apple hardware still doesn't make any sense to me.