Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Claude Code removed from Anthropic's Pro plan. Parent comment
it goes into detail about llama-server args; quants to try; and layer/kv cache splits. I plan to try the techniques there.
There are no comments on this comment yet.
it goes into detail about llama-server args; quants to try; and layer/kv cache splits. I plan to try the techniques there.