News for hackers. Stuff that matters.
Re:Langchain Is Pointless by jpulec on Saturday July 08, 2023 @04:29PM (#36648395)
I've been using the JS version of langchain for a few months now, and despite there being a lot of valid criticism, (especially around the abstractions it provides) I'm still glad to be using it.

We get the benefits of a well used library, which means making certain changes is easy. For example, swapping our vector database was a one line change, as was swapping our cache provider. When OpenAI released GPT-4, we were able to change one parameter, and everything still just worked.

Sure, it's moving fast, and could use a lot better documentation. At this point, I've probably read the entire source code several times over. But when we start testing performance of different models, or decide that we need to add persistent replayability to chains of LLM calls, it should be pretty easy. These things matter to production applications.

Re:Langchain Is Pointless by mmq on Saturday July 08, 2023 @04:36PM (#36648472)
> When OpenAI released GPT-4, we were able to change one parameter, and everything still just worked.

Wouldn't that be the same if you used the OAI js library directly? Basically swapping the model parameter?

Re:Langchain Is Pointless by jpulec on Saturday July 08, 2023 @05:09PM (#36648807)
It's not. The API is different, since GPT-4 is a chat based model, and davinci isn't. It's not a huge difference, but these little sort of things add up.
Re:Langchain Is Pointless by mmq on Saturday July 08, 2023 @05:28PM (#36648959)
I see, thought you were using GPT-3.5 and moved to GPT-4.
Re:Langchain Is Pointless by dbish on Sunday July 09, 2023 @02:15AM (#36652058)
It is a very minor change (made the changes in minutes and didn't have to bring in a new framework for it).
Re:Langchain Is Pointless by shepardrtc on Tuesday July 11, 2023 @09:17AM (#36680551)
Agreed. It's a trivial change, certainly not a justification for using langchain.