News for hackers. Stuff that matters.

A comment on Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s): 50 tok/s with MTP. Parent comment

Re:Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s)... by pich on Monday August 17, 2026 @12:09PM (#49333311)
5.01 BPW custom hybrid: bulk NVFP4, selected Q5_K/Q6_K tensors from an iMatrix, Q6_K embeddings and Q8_0 lm_head. The iMatrix was built from 5,472 messages across 296 real Hermes sessions
[ Parent | on HN ]
Re:Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s)... by ramon156 on Monday August 17, 2026 @12:14PM (#49333403)
Glad to read theyre not 296 fake Hermes sessions /s
[ Parent | on HN ]