News for hackers. Stuff that matters.
Re:Inkling 2 Mini by lwarfield on Friday November 20, 2026 @04:11PM (#50582173)
Omg I've been working on the same thing! I was doing this off a hunch from David Noel ng's RYS posts!

https://dnhkng.github.io/posts/rys/

Re:Inkling 2 Mini by mapontosevenths on Friday November 20, 2026 @05:11PM (#50583036)
I tried that for awhile too. Fun tip: You don't have to retrain the entire model after looping it to make it coherent again.. Just pick layers carefully then repair the residual by doing some parent distillation. ;)

That took me from needing to rent space in avast to just running it locally on my sparks and getting comparable results.

I also discovered that you can fix a lot of the damage caused by quantization the same way. Just do 200-500 rounds of parent student distillation with everything frozen but the residual, often the quantized version will improve drastically.