Qwen3.7-Max: The Agent Frontier

Re:Qwen3.7-Max: The Agent Frontier by mft_ on Wednesday May 20, 2026 @01:44PM (#48211343)

The 27B model is dense, so is relatively slow. The 35B-A3B model is marginally weaker but being MoE is much faster - like ~4-8x faster in basic benchmarks on my M1 Max.

For comparison, I just ran a couple of quick benchmarks (default settings) with llama-bench:

Qwen3.6-35B-A3B at Q6_K_XL gave 858 t/s pp512 (prompt processing) and 43 t/s tg128 (token generation).

Qwen3.6-27B at Q4_K_XL gave 103 t/s pp512 and 8 t/s tg128.

[ Parent | on HN ]

Re:Qwen3.7-Max: The Agent Frontier by pixelesque on Wednesday May 20, 2026 @02:25PM (#48211905)

Thanks for the info.

[ Parent | on HN ]

Re:Qwen3.7-Max: The Agent Frontier by stebalien on Wednesday May 20, 2026 @06:05PM (#48214867)

Have you tried enabling MTP? Those numbers are similar to what I was getting on my Strix Halo box, but configuring/enabling MTP doubled the TG speed of the 27B model (18-20 t/s now).

[ Parent | on HN ]

Re:Qwen3.7-Max: The Agent Frontier by mft_ on Thursday May 21, 2026 @03:25PM (#48227767)

Thanks - I’m in the process. I’ve tried briefly, but so far it appears marginally slower. (Noting that llama-bench doesn’t support MTP yet so you’re reduced to running different prompts and eyeballing the log.)

So I’m assuming I’ve done something wrong along the way, but I’ve not had time yet to explore it.

[ Parent | on HN ]