News for hackers. Stuff that matters.
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by KRAKRISMOTT on Sunday July 23, 2023 @02:47PM (#36838373)
You are right, my mistake, it should be text-embedding-ada. Thanks for the info about instructor, will check it out. What do you usually use LLMs for?
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by npsomaratna on Sunday July 23, 2023 @11:00PM (#36842641)
Mainly for data processing, and almost exclusively "open-source" LLMs now (essential given our focus on industries with tons of confidential data). Let me plug my startup's website, which describes what we do: https://www.amw.ai/
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by ianpurton on Monday July 24, 2023 @02:25AM (#36843762)
From you home page, I couldn't figure out exactly what you do.

Can you parse PDF into embeddings for a vector database?

Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by kirdiekirdie on Thursday July 27, 2023 @11:19AM (#36894906)
localGPT can parse PDF into embeddings, see <https://github.com/PromtEngineer/localGPT>.