News for hackers. Stuff that matters.
Re:Inkling 2 Mini by XenophileJKO on Friday November 20, 2026 @05:09PM (#50583007)
This has been my line of thought for a years. If we are aiming for on device intelligence, looping (or other methods of parameter reuse) are one of the best methods since consumer hardware is primarily memory constrained.

Which is counter to the way most open weight models have been leaning. Many current models are MoE (Mixture of Experts) which by their very nature are parameter heavy. They are trading parameter efficiency for compute efficiency which is kind of the wrong tradeoff for current consumer hardware like gaming GPUs.

Re:Inkling 2 Mini by coder543 on Friday November 20, 2026 @05:18PM (#50583114)
[delayed]
Re:Inkling 2 Mini by Eisenstein on Friday November 20, 2026 @05:58PM (#50583556)
[delayed]
Re:Inkling 2 Mini by coder543 on Friday November 20, 2026 @06:04PM (#50583617)
[delayed]
Re:Inkling 2 Mini by stymaar on Friday November 20, 2026 @11:44PM (#50586018)
> since consumer hardware is primarily memory constrained.

It depends, people with Macs or AMD with unified memory are more constrained by memory bandwidth than with resident memory.

Unfortunately for us, looping doesn't help on that from.