Re:The M×N problem of tool calling and open-source models
by ethan_smith on Tuesday April 14, 2026 @04:21PM
(#47770965)
They do, but that's kind of the article's point - someone still has to write and maintain the per-model chat template and tool call parsing inside vllm/sglang. Every time a new model ships with a slightly different format, the inference server needs an update. The M×N problem doesn't disappear, it just gets pushed one layer down.
[ Parent
| on HN ]
There are no comments on this comment yet.