News for hackers. Stuff that matters.
Re:Edge0-145B: Frontier AI Capabilities on Your Own Computer by quicklywilliam on Thursday November 12, 2026 @10:04PM (#50477628)
This smells off.
Re:Edge0-145B: Frontier AI Capabilities on Your Own Computer by SillyUsername on Thursday November 12, 2026 @11:50PM (#50478488)
So did Strata Vs Llama.cpp, yet Strata pulls 2.5 to 3x the performance of the Llama.cpp codebase it was based on. If they've improved the architecture further by sharing experts, then this might be plausible.
Re:Edge0-145B: Frontier AI Capabilities on Your Own Computer by aktenlage on Saturday November 14, 2026 @04:36AM (#50495531)
You are not wrong, but it depends on the available hardware. I can run llama.cpp with Qwen 35B-A3B with usable speed (30ish t/s tg) on my laptop, but strata doesn't run at all, because my VRAM doesn't suffice.