[delayed]
Re:Inkling 2 Mini
by Eisenstein on Friday November 20, 2026 @05:58PM
(#50583556)
[delayed]
[delayed]
> since consumer hardware is primarily memory constrained.
It depends, people with Macs or AMD with unified memory are more constrained by memory bandwidth than with resident memory.
Unfortunately for us, looping doesn't help on that from.
Which is counter to the way most open weight models have been leaning. Many current models are MoE (Mixture of Experts) which by their very nature are parameter heavy. They are trading parameter efficiency for compute efficiency which is kind of the wrong tradeoff for current consumer hardware like gaming GPUs.