Re:Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s)...
by mhitza on Monday August 17, 2026 @01:00PM
(#49334178)
What do you use instead of llama.cpp? With vllm for example most models don't seem to be supported out of the box.
[ Parent
| on HN ]
There are no comments on this comment yet.