Re:Show HN: Jevstiller – Distill Jev into a local model, wit...
by dotancohen on Tuesday September 29, 2026 @06:59PM
(#49901981)
Yeah, I kinda figured that head was the whole model, the way you phrased it. scikit-learn?
[ Parent
| on HN ]
Re:Show HN: Jevstiller – Distill Jev into a local model, wit...
by tgluck on Tuesday September 29, 2026 @07:08PM
(#49902072)
No, plain numpy. It's full-batch Adam on cross-entropy against soft targets, about 80 lines.
Re:Show HN: Jevstiller – Distill Jev into a local model, wit...
by dotancohen on Wednesday September 30, 2026 @04:26AM
(#49905988)
I'll look into Adam, thank you!