Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on M2 Ultra can run 128 streams of Llama 2 7B in parallel. Parent comment
That seems very slow compared to llama cpp?
That seems very slow compared to llama cpp?