Re:GPT-5.6
by linkregister on Thursday July 09, 2026 @07:34PM
(#48853855)
Modern pretraining also consists of expensive human-led specialized task creation and grading loops. Synthetic generation and distillation from previous models is another input for training. I wonder how much new text contributes beyond keeping knowledge up-to-date.
[ Parent
| on HN ]
There are no comments on this comment yet.