News for hackers. Stuff that matters.
Re:Show HN: Steerling-8B, a language model that can explain ... by adebayoj on Tuesday February 24, 2026 @08:36AM (#47136981)
We train the model with `explanations`. Most training asks the model to predict the next token or group of tokens. Our training says, predict the next group of tokens (causal diffusion), but also these tokens should be about {sports/art/coding/etc}. So in addition to token supervision, the model gets concept level supervision. The model is forced to more quickly learn these high level concepts.

There are no comments on this comment yet.