Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Running LLaMA 7B on a 64GB M2 MacBook Pro with Llama.cpp. Parent comment
(20 tokens/second on a Mac is for the smallest model, ~5x smaller than 30B and 10x smaller than 65B)
(20 tokens/second on a Mac is for the smallest model, ~5x smaller than 30B and 10x smaller than 65B)