Ask HN: How do I train a custom LLM/ChatGPT on my own documents in Dec 2023?

Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by isoprophlex on Monday December 25, 2023 @01:51AM (#38760430)

You basically don't use langchain for anything besides 30 minute demos that you copied from someone else's github. It has a completely spaghettified API, is not performant, and forces you into excessive mental contortions to reason about otherwise simple tasks.

LlamaIndex is pretty good.

[ Parent | on HN ]

Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by monkeydust on Monday December 25, 2023 @04:07AM (#38761010)

Yea discovered this with Langchain last week. Was great for a demo then started to push it harder and spent ages trawling Reddit, discord, GitHub trying to find solutions to issues only to discover what was supposed to be supported was deprecated. Got a massive headache for what should have been a simple change. Moved on now.

[ Parent | on HN ]

Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by sophiabits on Monday December 25, 2023 @04:48AM (#38761229)

Yeah +1

We originally started out building features with LangChain (loading chains from YAML sounded good—it felt like it would be easy to get non-engineers to help with prompt development) but in practice it’s just way too complicated. Nice idea, but the execution feels lacking.

It also doesn’t help that LangChain is evolving so rapidly. When we first started using it a lot of code samples on the internet couldn’t be copy/pasted because of import paths changing, and at one point we had to bump by ~60 patch versions to get a bug fix, which was painful because it broke all kinds of stuff

[ Parent | on HN ]