News for hackers. Stuff that matters.

A comment on Show HN: Steerling-8B, a language model that can explain any token it generates.

Re:Show HN: Steerling-8B, a language model that can explain ... by whinvik on Tuesday February 24, 2026 @07:09AM (#47136122)
Looks very interesting. Can you comment on why you think this model can give comparable performance with less training data?
[ Parent | on HN ]
Re:Show HN: Steerling-8B, a language model that can explain ... by adebayoj on Tuesday February 24, 2026 @08:36AM (#47136981)
We train the model with `explanations`. Most training asks the model to predict the next token or group of tokens. Our training says, predict the next group of tokens (causal diffusion), but also these tokens should be about {sports/art/coding/etc}. So in addition to token supervision, the model gets concept level supervision. The model is forced to more quickly learn these high level concepts.
[ Parent | on HN ]