News for hackers. Stuff that matters.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by cubefox on Monday November 09, 2026 @12:15PM (#50428449)
What's that?
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by johntb86 on Monday November 09, 2026 @12:54PM (#50428960)
https://arxiv.org/abs/2602.06036 - they use a faster (single-pass) diffusion model to generate predictions for 7 to 15 tokens in a single step. Then if they're accepted that really speeds up the autoregressive model because it doesn't have to generate tokens one at a time.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by cubefox on Monday November 09, 2026 @10:57PM (#50435879)
I'm pretty sure fast speculative decoding models need to have the same objective (NTP, MDM, NCM) as the larger model they try to accelerate.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by 3836293648 on Tuesday November 10, 2026 @04:54PM (#50446838)
Just for additional context: You have to do more computational work to check them, beyond the extra work in the drafter, but you have much less of a memory bottleneck, which is extremely worth it on current hardware.