Re:DeepSeek V4 Flash 0731
by nmitchko on Saturday August 08, 2026 @06:12AM
(#49220375)
It’s an adaptation of CoLaR, but my implementation is a little different:
- Dedicated stop head to fire when latent thinking hits threshold
- MTP support with training taking draft support as first class
- different architectural layer 35 -> layer 42 writeback. So latents skip roughly 6.2 tokens of reasoning per token, then never make it to decoded output
[ Parent
| on HN ]
There are no comments on this comment yet.