News for hackers. Stuff that matters.
Re:LangChain: The Missing Manual by bestcoder69 on Friday May 19, 2023 @04:23PM (#36006430)
Has langchain had positive ROI for anyone beyond the initial prototype of their app? My experience has me skeptical - I end up feeling like I'm painted into a corner and need to start over. Maybe if I just used PromptTemplate and LLMChain, but at that point I can just use function composition and formatted strings.

Like I'd be blown away if someone had a production app where they were able to swap LLM providers (and nothing else) due to langchain. And if that expectation is too high then why not just code against the openai API?

Re:LangChain: The Missing Manual by behnamoh on Friday May 19, 2023 @04:30PM (#36006518)
I'd argue that building your app based on a quickly evolving library is not a wise idea, esp. if the library is not well documented.
Re:LangChain: The Missing Manual by hdd2k on Friday May 19, 2023 @04:28PM (#36006484)
+1 on this experience. Langchain is great at wrapping simpler tasks, but once you start to decouple components you start to run into issues.
Re:LangChain: The Missing Manual by axpy906 on Friday May 19, 2023 @06:47PM (#36007672)
Outside a prototype what’s the benefit? The steps I envision are: 1) turn prompt to embeddings 2) return examples that match from vector db 3) load as examples 4) prompt LLM with examples. Am I missing something? Why on earth would you want to import multiple dependencies for this?