News for hackers. Stuff that matters.
Re:Anthropic IPO by naraic0o on Thursday November 12, 2026 @12:04PM (#50470522)
what quant and engine? i have the same hardware and i get 40tps with a 4bit quant using omlx + splash. which is about the same as opus, or faster, maybe? with its caching the time to first token is also very impressive.

There are no comments on this comment yet.