Re:Ask HN: How to train and host an LLM for internal docs
by andrewdevdocsai on Friday June 30, 2023 @01:17PM
(#36538702)
Do you have a scope of what you want the llm to do? If it is just answering questions on the data then you likely don’t need to do a lot of training. I think the problem is more the infra setup, the embedding database, and the cost of hosting a model for inference and so on. Transparently I am also the founder of a start up that is providing this as a service, so feel free to book some time if you are interested in us doing it for you or if you want tips on how to do it yourself. Here is my Calendly if you want to talk: https://calendly.com/andrew-vb
[ Parent
| on HN ]
Re:Ask HN: How to train and host an LLM for internal docs
by nborwankar on Friday June 30, 2023 @03:39PM
(#36541000)
Yes mostly answering questions and also summarizing and exploring by asking for explanations (understanding there could be non trivial amounts of hallucination)
Really appreciate you offering advice. Will book time after the long weekend.