Re:Handbook.md shows that long policy documents do not relia...
by mordae on Wednesday July 29, 2026 @09:54AM
(#49097579)
To run at decent speed, all models try hard to use only most likely relevant part of the context and most likely relevant weights (MoE) to predict the next token. Doing the math in full is unfeasible.
not sure I got it?
Separately, the frontier labs are kinda pushing us into that behaviour by releasing models with ever-larger context windows.