News for hackers. Stuff that matters.
Re:Ask HN: How to train and host an LLM for internal docs by quickthrower2 on Friday June 30, 2023 @12:00AM (#36530368)
How local? As in on premise? Or could it run on a cloud VM?
Re:Ask HN: How to train and host an LLM for internal docs by nborwankar on Friday June 30, 2023 @05:30PM (#36542594)
Cloud VM possible, not sure. Is it possible to run on HuggingFace without compromising data privacy?On-premise preferred. Capital cost to get to “Hello world” will probably convince principals to use HuggingFace if data privacy concerns can be met.