Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Experimenting with Local LLMs on macOS. Parent comment
A 70b dense model is slower
Qwen coder 30b Q4 runs 40+.
There are no comments on this comment yet.
A 70b dense model is slower
Qwen coder 30b Q4 runs 40+.