News for hackers. Stuff that matters.
Re:Qwen3.8-Max: A New Bar for Coding and Cowork by Forgeties79 on Monday August 03, 2026 @03:03PM (#49160059)
I'm running Qwen 27B no problem with an AMD 9070XT + 24gb DDR5 ram. Does basic web search for me (tool call with tavily, costs nothing I get 1000 searches a month) and is great for creative writing (primarily breaking writer's block). Until the recent surge in ram costs, that wouldn't be hard to do. I built the computer for ~$1600 a year ago.
Re:Qwen3.8-Max: A New Bar for Coding and Cowork by NekkoDroid on Monday August 03, 2026 @03:17PM (#49160195)
I am getting ~13-15 tps with my 9070XT for the 27B (~35tps for the 35B-A3B), but I think for me the main bottleneck is the 64gb of DDR4 3600 memory. What kinda speeds are you getting with what speed of DDR5?
Re:Qwen3.8-Max: A New Bar for Coding and Cowork by Forgeties79 on Monday August 03, 2026 @09:05PM (#49163281)
I’m a little more novice than a lot of the people on this site so take my response with a grain of salt.

The wall I keep hitting is I can run models like I described (Q3-4 usually), but it’s very sensitive to context. Once I start getting past 7.5k or so it can really fall apart. Sometimes before that. It just really depends.

If I run smaller ones that offload less to ram, they stay somewhat coherent but don’t quite do what I want them to do.

Your token speeds are not that much slower than mine. I imagine part of it is I’m not fine-tuning it very well. On a good day I’ll get like…15tps.