News for hackers. Stuff that matters.
Re:Qwen3.5: Towards Native Multimodal Agents by embedding-shape on Monday February 16, 2026 @08:15AM (#47034578)
Curious what the prefilled and token generation speed is. Apple hardware already seem embarrassingly slow for the prefill step, and OK with the token generation, but that's with way smaller models (1/4 size), so at this size? Might fit, but guessing it might be all but usable sadly.
Re:Qwen3.5: Towards Native Multimodal Agents by regularfry on Monday February 16, 2026 @10:01AM (#47035866)
They're claiming 20+tps inference on a macbook with the unsloth quant.
Re:Qwen3.5: Towards Native Multimodal Agents by embedding-shape on Monday February 16, 2026 @12:48PM (#47037930)
Yeah, I'm guessing the Mac users still aren't very fond of sharing the time the prefill takes, still. They usually only share the tok/s output, never the input.