News for hackers. Stuff that matters.
Re:DeepSeek V4 Flash 0731 by nmitchko on Saturday August 08, 2026 @06:12AM (#49220375)
It’s an adaptation of CoLaR, but my implementation is a little different: - Dedicated stop head to fire when latent thinking hits threshold - MTP support with training taking draft support as first class - different architectural layer 35 -> layer 42 writeback. So latents skip roughly 6.2 tokens of reasoning per token, then never make it to decoded output

There are no comments on this comment yet.