News for hackers. Stuff that matters.
Re:Qwen/Qwen3.8-2.4T-A95B by segmondy on Wednesday August 12, 2026 @04:05PM (#49277872)
... because they are often the first to quant it. sometimes the actually model providers will release wrong chat templates or values in the model config which leads to bad quants. how would you know a quant is good if you don't make one? you don't. so they make it first, then they run a lot of tests, KD, perplexity, etc, they publish it. They take feedback from the community, then they update if needed. if you want to try it right now, you grab it else wait for a week or 2.
Re:Qwen/Qwen3.8-2.4T-A95B by Foobar8568 on Wednesday August 12, 2026 @04:16PM (#49277980)
Gemma4 was released a few weeks ago? The problems are still there. Today I started using another "provider" and the problems disappeared. Thanks but no.
Re:Qwen/Qwen3.8-2.4T-A95B by arcanemachiner on Wednesday August 12, 2026 @04:22PM (#49278053)
They are very responsive, and would probably be happy to help you fix your issues.
Re:Qwen/Qwen3.8-2.4T-A95B by danielhanchen on Wednesday August 12, 2026 @06:39PM (#49279552)
Hey yes - if you could describe what the issues are - we will gladly fix them!
Re:Qwen/Qwen3.8-2.4T-A95B by Foobar8568 on Thursday August 13, 2026 @12:58PM (#49288795)
Mea-culpa, dry-multiplier generated crap and even more so on Gemma4.
Re:Qwen/Qwen3.8-2.4T-A95B by danielhanchen on Friday August 14, 2026 @02:12AM (#49295255)
Ok no worries - if there are any future issues - feel free to message / make a HF issue - we'll fix promptly!

Also note its best to follow Gemma4's official sampling params since they evaled with it - dry multiplier sometimes works, but it actually screws up reasoning sometimes

Re:Qwen/Qwen3.8-2.4T-A95B by segmondy on Wednesday August 12, 2026 @06:39PM (#49279565)
I've 0 issues with gemma4 and I downloaded it early.
Re:Qwen/Qwen3.8-2.4T-A95B by LeBit on Wednesday August 12, 2026 @09:07PM (#49280619)
Same. Used the 12B, 26B A4B and 31B.

No issues with llama.cpp.