News for hackers. Stuff that matters.
Re:A few words on DS4 by DeathArrow on Friday May 15, 2026 @02:09AM (#48145114)
Thanks, I can run Qwen 3.6 27B with vllm, but I was curious about antirez tool.
Re:A few words on DS4 by embedding-shape on Friday May 15, 2026 @07:48AM (#48147425)
Have you had it getting stuck in endless loops maybe ~10-20% of the invocations? Seems it happens for both the responses and chatcompletion APIs, and no matter what inference parameters I try it happens at least for 1/10 of the requests, I've tried every compatible vLLM version + currently using it from git (#main) yet the issue persists.

Seems to happen with various quantizations too, even the NVFP4 versions and any others, so seems like a deeper issue to me, or hardware incompatible perhaps.

Re:A few words on DS4 by modmans2nd on Friday May 29, 2026 @07:21AM (#48321711)
There’s a fixed version out there with corrected templates.