News for hackers. Stuff that matters.
Re:Fixing Tool-Call Accuracy in vLLM by jesdo on Monday October 26, 2026 @11:42AM (#50245660)
Overall, a fair assessment. I do want to place a footnote here that we did fix vLLM in the sense that its correct behavior for Kimi required code changes: it was impossible to fix it in the configuration. Later, the vLLM team fixed this problem upstream. Now, with the latest version of vLLM, the problem we describe can be addressed by setting the `--tool-strict-level` flag to `parameter`.
Re:Fixing Tool-Call Accuracy in vLLM by wredcoll on Tuesday October 27, 2026 @01:10AM (#50254922)
If you work for ubicloud, I have a question: do you sell api access to kimi/etc, and if so, where is that listed??
Re:Fixing Tool-Call Accuracy in vLLM by jesdo on Tuesday October 27, 2026 @11:25AM (#50260772)
We currently focus on serving DeepSeek models on dedicated clusters for large customers. We do not offer this as a publicly available service at the moment, but we may consider doing so in the future.