andrewdevdocsai
andrewdevdocsai on Hacker News
Re:Ask HN: How to train and host an LLM for internal docs
on Friday June 30, 2023 @01:17PM (#36538702)
Do you have a scope of what you want the llm to do? If it is just answering questions on the data then you likely don’t need to do a lot of training. I think the problem is more the infra setup, the embedding database, and the cost of hosting a model for inference and so on. Transparently I am also the founder of a start up that is providing this as a service, so feel free to book some time if you are interested in us doing it for you or if you want tips on how to do it yourself. Here is my Calendly if you want to talk: https://calendly.com/andrew-vb