News for hackers. Stuff that matters.

A comment on Claude Opus 4.8. Parent comment

Re:Claude Opus 4.8 by girvo on Thursday May 28, 2026 @06:47PM (#48316622)
> I suspect nobody is doing real student teacher distillation

It gets used for quantisation, basically recovering accuracy for lower quants (Nvidia calls it QAD). Can’t speak to how widespread it is though

[ Parent | on HN ]
Re:Claude Opus 4.8 by rao-v on Thursday May 28, 2026 @07:08PM (#48316800)
Yes absolutely! I should have been more specific - I don’t believe people are using it to train 30B models from 300B models (and I’d love to learn that I’m off about this)
[ Parent | on HN ]