Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Lenovo Has a CXL Memory Monster with 128x 128GB DDR5 DIMMs. Parent comment
I tested out running Llama on a 512GB machine, it's rather slow and inefficient. Maybe 1-token/sec.
There are no comments on this comment yet.
I tested out running Llama on a 512GB machine, it's rather slow and inefficient. Maybe 1-token/sec.