News for hackers. Stuff that matters.

A comment on Is LMDeploy the Ultimate Solution? Why It Outshines VLLM, TRT-LLM, TGI, and MLC. Parent comment

Re:Is LMDeploy the Ultimate Solution? Why It Outshines VLLM,... by helloericsf on Thursday June 20, 2024 @12:23PM (#40740442)
Personally, I never seen onnx used for LLM.
[ Parent | on HN ]

There are no comments on this comment yet.