News for hackers. Stuff that matters.
Re:Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s)... by mhitza on Monday August 17, 2026 @01:00PM (#49334178)
What do you use instead of llama.cpp? With vllm for example most models don't seem to be supported out of the box.

There are no comments on this comment yet.