News for hackers. Stuff that matters.
Re:Kimi K3 (2.8T) at 1 token/s on a MacBook Pro, streamed fr... by Izmaki on Tuesday September 08, 2026 @05:45PM (#49617551)
This is what people forget when they see slow performance: at 1 t/s it's still roughly the equivalent of having another person work for you at no extra cost besides the initial purchase/sign-on-bonus.

Frontier models are amazing, but what will really be useful for us is having models and hardware so efficient that you can run useful LLMs locally. One of my favourite LLMs to this day is still my jail-broken gemma4 12b because it's small enough to run on my computer, but also 100% local and free as in liberty.

Re:Kimi K3 (2.8T) at 1 token/s on a MacBook Pro, streamed fr... by copperx on Tuesday September 08, 2026 @05:55PM (#49617687)
How are you running it, if I may ask?
Re:Kimi K3 (2.8T) at 1 token/s on a MacBook Pro, streamed fr... by Izmaki on Wednesday September 09, 2026 @03:30PM (#49632782)
How am I running a jailbroken gemma 4? It's fairly easy to convince to disregard its previous policies with a slightly tweaked, generic SYSTEM prompt.