Re:Edge0-145B: Frontier AI Capabilities on Your Own Computer
by dust42 on Friday November 13, 2026 @05:48AM
(#50481578)
And their model is just derived from Qwen3.8-next-flash which you can see when going to their HF page. Not much details to be found about the company apart from the founder who "was named in MIT Technology Review's Innovators Under 35".
Not much innovation here though it seems. More like a marketing stunt to collect VC.
Qwen3.8-next-flash is impressive though, especially with Strata or Basalt as inference engines. On a 5090 laptop with 64GB RAM one can run NVFP4 quants at 120-140t/s decode and 3000-4000t/s prefill.
On Mac it is much slower and the Kapitsa engine probably the best bet. Despite the claim of 29GB RAM for Edge0, in order to be fast you need to have at least a 128GB Mac.
Re:Edge0-145B: Frontier AI Capabilities on Your Own Computer
by vardump on Friday November 13, 2026 @06:27AM
(#50481982)
How about Splash on Apple silicon? I've heard it's pretty fast.
Re:Edge0-145B: Frontier AI Capabilities on Your Own Computer
by francisjp on Friday November 13, 2026 @12:08PM
(#50486445)
it is fast, 2x faster prefill and decode than similar quants than oMLX. At least in my limited, and unscientific, 36 hour+ tests
https://github.com/JamesFranc/refactored-parakeet/blob/main/...
They're not hiding that fact once you get to the repo. I mean it's called edge0-strata and the README says it's a fork of strata.
It's weird to see this marketing web page imply that it was all new and novel work that they did, though.