News for hackers. Stuff that matters.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by pinyen_cheng on Monday November 09, 2026 @04:44AM (#50423325)
That's pretty innovative. But a brand new tokenizer and training method need a lot of effort to do the retraining. Whether it will be widely implemented depends on real frontier performance it can reach.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by alansaber on Monday November 09, 2026 @07:38AM (#50424773)
Exactly. I used to think new tokenizers for domain-specific models was the way (makes intuitive sense, better representations etc), but the added overhead of essentially training from scratch made it much more expensive than a FT.