News for hackers. Stuff that matters.

A comment on Hy3. Parent comment

Re:Hy3 by spmurrayzzz on Thursday July 09, 2026 @12:35PM (#48848628)
I think its good advice to test both on your own evals for sure, but the MoE parameters are already natively FP4 in ds4. Dropping to 2bpw isn't as big of a loss as it seems (and as corroborated by antirez's work).

Its also only 13B active, so your decode speed would be nearly 2x that of Qwen3.6-27B. So there are other latent benefits as well.

[ Parent | on HN ]
Re:Hy3 by verdverm on Thursday July 09, 2026 @01:30PM (#48849525)
z-lab has been dropping dflash addons for a lot of models

https://huggingface.co/collections/z-lab/dflash

I'm running the qwen3.6-27B + dflash on a spark and tgen is way up, but keep the draft count low, acceptance rate is terrible beyond half a dozen and it requires more memory

[ Parent | on HN ]
Re:Hy3 by bjconlan on Thursday July 09, 2026 @07:32PM (#48853834)
Wow thanks for pointing this out! This is actually what I was hoping would happen when the deepspec stuff dropped! And having zlab create these confirms my bias that I think open models are the way.
[ Parent | on HN ]