News for hackers. Stuff that matters.

A comment on RTX 5080 and RTX 3090 Setup: 80 Tok/s on Qwen 3.6 27B Q8. Parent comment

Re:RTX 5080 and RTX 3090 Setup: 80 Tok/s on Qwen 3.6 27B Q8 by iMil on Saturday June 13, 2026 @01:06PM (#48519188)
2xRTX5080 would be awesome. You'd only be able to run a q6, which it's already pretty good, but moreover you'd be able to use P2P and use Blackwell full speed, which I can't.
[ Parent | on HN ]
Re:RTX 5080 and RTX 3090 Setup: 80 Tok/s on Qwen 3.6 27B Q8 by kcb on Saturday June 13, 2026 @09:56PM (#48523435)
With 2 Blackwells, would make sense to run NVFP4 quants
[ Parent | on HN ]