News for hackers. Stuff that matters.

A comment on Edge0-145B: Frontier AI Capabilities on Your Own Computer. Parent comment

Re:Edge0-145B: Frontier AI Capabilities on Your Own Computer by vardump on Friday November 13, 2026 @06:27AM (#50481982)
How about Splash on Apple silicon? I've heard it's pretty fast.

https://github.com/incoai/splash

[ Parent | on HN ]
Re:Edge0-145B: Frontier AI Capabilities on Your Own Computer by francisjp on Friday November 13, 2026 @12:08PM (#50486445)
it is fast, 2x faster prefill and decode than similar quants than oMLX. At least in my limited, and unscientific, 36 hour+ tests

https://github.com/JamesFranc/refactored-parakeet/blob/main/...

[ Parent | on HN ]