News for hackers. Stuff that matters.

A comment on Is LMDeploy the Ultimate Solution? Why It Outshines VLLM, TRT-LLM, TGI, and MLC. Parent comment

Re:Is LMDeploy the Ultimate Solution? Why It Outshines VLLM,... by chaoyu on Thursday June 20, 2024 @12:06PM (#40740279)
onnx is not a good option for LLM type of autoregressive generation
[ Parent | on HN ]

There are no comments on this comment yet.