And I assume the metrics comparing qwen are using a quantized version - from the blog they compare memory use against qwen's "standard 4-bit deployment". Which might explain the improved performance over that base model they show - it might lose less from quantization.
https://github.com/Edge0-AI/Edge0/blob/main/licenses/edge0-m...
This looks like it would actually work on my 64mb M1 MBP. That would be fantastic.
https://huggingface.co/ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RC...
Hobbyist, sure, too expensive for most? OTOH as a kid, my parents sweated to accumulate $5k worth of computer (and 5.25" drives!) in today's dollars, so that investment paid off.
The inference engine they use is called edge0-strata because it's a strata fork.
This project looks like someone fine-tuned Qwen3.8 Flash Next, made some tweaks to the model, forked strata to run it, and then put a lot of marketing and branding on top of it