Re:GLM5 Released on Z.ai Platform
by pama on Thursday February 12, 2026 @08:33AM
(#46988628)
Cheap verifying of speculative decoding only works for a few tokens at a time. Long sequence generations (thousands to tens of thousands of tokens in typical rollouts for thinking models) are dominated by distribution drift on stale weights (because slightly wrong probabilities multiply over long streams), and the off policy RL training methods dont work well (high variance) for such high dimensional problems.
[ Parent
| on HN ]
There are no comments on this comment yet.