News for hackers. Stuff that matters.
Re:Self-Host LLMs with VLLM and BentoML by permalac on Saturday April 27, 2024 @02:17PM (#40182171)
What are the hardware specs needed to run this?