Re:Anthropic IPO
by naraic0o on Thursday November 12, 2026 @12:04PM
(#50470522)
what quant and engine? i have the same hardware and i get 40tps with a 4bit quant using omlx + splash. which is about the same as opus, or faster, maybe? with its caching the time to first token is also very impressive.
[ Parent
| on HN ]
There are no comments on this comment yet.