News for hackers. Stuff that matters.

A comment on Self-Host LLMs with VLLM and BentoML.

Re:Self-Host LLMs with VLLM and BentoML by permalac on Saturday April 27, 2024 @02:17PM (#40182171)
What are the hardware specs needed to run this?
[ Parent | on HN ]

There are no comments on this comment yet.