News for hackers. Stuff that matters.
Re:LFM2.5-24B-A2B: Built for Fast On-Device Agents by kerenskiy on Thursday October 15, 2026 @08:57AM (#50102986)
The context window fills up also/mostly from prefil which is supposed to be 20+ times faster or so. I think 40-80 tps for decode/output is believable for claude models

There are no comments on this comment yet.