People have been saying this since we first started having local models … that were too big to run locally.
It would be great if it was true.
Running a local frontier model is the dream.
…but, its been obvious since the beginning that this is a fantasy without a paradigm shift.
People want general purpose models. People want parallel models. People want fast models.
This is interesting, because it does represent a paradigm shift, perhaps… but most people saying “Ive been expecting this…” have simply not had a realistic understanding of complexities involved.
Personally; Im skeptical. This is what people were saying about 1 bit models. That turned out to make very little meaningful diff and did not result in a local hosting utopia.
I guess we will see… I feel like we will see slow incremental improvements in this space.
It would be great if it was true.
Running a local frontier model is the dream.
…but, its been obvious since the beginning that this is a fantasy without a paradigm shift.
People want general purpose models. People want parallel models. People want fast models.
This is interesting, because it does represent a paradigm shift, perhaps… but most people saying “Ive been expecting this…” have simply not had a realistic understanding of complexities involved.
Personally; Im skeptical. This is what people were saying about 1 bit models. That turned out to make very little meaningful diff and did not result in a local hosting utopia.
I guess we will see… I feel like we will see slow incremental improvements in this space.
Sub 1B coding models remains a fantasy for now.