> Something is up.
This is why open weights win. Deep transparency and the permissionless opportunity for anyone to investigate/benchmark is of primal importance to me. I'm not keen to have corporate-government (oligarchy) gatekeepers.
Getting an OEM (DGX) Spark is good if you want complete control or an excellent learning environment. You can do much more than just run llms for tokens (which will be generated much slower). They have become much more pricey tho...
Kimi K3 is good at the high end, DS 4.1 flash is good, most flash models are sufficient (I typically start a task here), I like qwen 27B at the small end (dense is better than MoE at this size).
I care the most about quality. It can be more expensive, and slower. My problems with the AIs are always intelligence related/effort related.
So I'm not sure if those smaller models you listed will be effective, given that I am having to turn to chatgpt.com's Pro to get quality answers.
Interested in Kimi & DS
Something is up.