News for hackers. Stuff that matters.
Re:Moondream 3 Preview: Frontier-level reasoning at a blazin... by nicohayes on Saturday September 27, 2025 @08:19AM (#45395078)
Could you clarify whether the 2B active parameter concept refers to per-token inference and how this scales with context length? Specifically how MoE affects activation during inference and any practical implications for latency.

There are no comments on this comment yet.