News for hackers. Stuff that matters.
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by wilkystyle on Thursday December 25, 2025 @03:28PM (#46386842)
Can you elaborate? Fairly new to langchain, but didn't realize it had any sort of stereotypical type of user.
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by XCSme on Thursday December 25, 2025 @04:15PM (#46387087)
I am not sure what's the stereotype, but I tried using langchain and realised most of the functionality actually adds more code to use than simply writing my own direct API LLM calls.

Overall I felt like it solves a problem doesn't exist, and I've been happily sending direct API calls for years to LLMs without issues.

Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by teruakohatu on Thursday December 25, 2025 @04:57PM (#46387297)
JSON Structured Output from OpenAI was released a year after the first LangChain release.

I think structured output with schema validation mostly replaces the need for complex prompt frameworks. I do look at the LC source from time to time because they do have good prompts backed into the framework.

Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by majormajor on Thursday December 25, 2025 @05:28PM (#46387430)
IME you could get reliable JSON or other easily-parsable output formats out of OpenAI's going back at least to GPT3.5 or 4 in early 2023. I think that was a bit after LangChain's release but I don't recall hitting problems that I needed to add a layer around in order to do "agent"-y things ("dispatch this to this specialized other prompt-plus-chatgpt-api-call, get back structured data, dispatch it to a different specialized prompt-plus-chatgpt-api-call") before it was a buzzword.
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by nostrebored on Thursday December 25, 2025 @09:55PM (#46388800)
Can guarantee this was not true for any complicated extraction. You could reliably get it to output json but not the json you wanted

Even on smallish ~50k datasets error was still very high and interpretation of schema was not particularly good.

Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by avaer on Friday December 26, 2025 @01:04AM (#46389591)
It's still not true for any complicated extraction. I don't think I've ever shipped a successful solution to anything serious that relied on freeform schema say-and-pray with retries.
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by avaer on Friday December 26, 2025 @01:01AM (#46389578)
To this day many good models don't support structured outputs (say Opus 4.5) so it's not a panacea you can count on in production.

The bigger problem is that LangChain/Python is the least set up to take advantage of strong schemas even when you do have it.

Agree about pillaging for prompts though.

Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by teruakohatu on Friday December 26, 2025 @05:00AM (#46390753)
> so it's not a panacea you can count on in production.

OpenAI and Gemini models can handle ridiculously complicated and convoluted schemas, if I needed complicated JSON output I wouldn’t use anything that didn’t guarantee it.

I have pushed Gemini 2.5 Pro further than I thought possible when it comes to ridiculously over complicated (by necessity) structured output.

Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by jmogly on Friday December 26, 2025 @07:32PM (#46397916)
100% Gemini + pydantic you don’t need a wrapper library in 2025
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by Insanity on Thursday December 25, 2025 @06:21PM (#46387703)
When my company organized an LLM hackathon last year, they pushed for LangChain.. but then instead of building on top of it I ended up creating a more lightweight abstraction for our use-cases.

That was more fun than actually using it.

Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by prodigycorp on Thursday December 25, 2025 @04:54PM (#46387285)
No dig at you, but I take the average langchain user as one who is either a) using it because their C-suite heard about at some AI conference and had it foisted upon them or b) does not care about software quality in general.

I've talked to many people who regret building on top of it but they're in too deep.

I think you may come to the same conclusions over time.

Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by inlustra on Thursday December 25, 2025 @05:13PM (#46387360)
Great insight that you wouldn’t get without HN, thank you! What would you and your peers recommend?
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by baobabKoodaa on Thursday December 25, 2025 @05:47PM (#46387516)
LangChain does not solve any actual problem, so there is no need to replace it with anything. Just build without it.
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by peab on Thursday December 25, 2025 @07:40PM (#46388099)
There's a great talk called Pydantic is all you need that i highly recommend
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by sumitkumar on Thursday December 25, 2025 @06:04PM (#46387608)
pydantic/pydanticAI in builder mode or llamaindex in solution architect mode.
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by wilkystyle on Thursday December 25, 2025 @10:42PM (#46389009)
Thanks for the reply, and no offense taken. I've inherited some code that uses LangChain, and this is my first experience with it.
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by int_19h on Thursday December 25, 2025 @05:54PM (#46387562)
I'll admit that I haven't looked it in a while, but as originally released, it was a textbook example on how to complicate a fundamentally simple and well-understood task (text templates, basically) with lots of useless abstractions that made it all sound more "enterprise". People would write complicated langchains, but then when you looked under the hood all it was doing is some string concatenation, and the result was actually less readable than a simple template with substitutions in it.
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by gcr on Thursday December 25, 2025 @06:47PM (#46387835)
What do you suggest instead? Handrolled code with “import openai”? BAML?
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by llmslave2 on Thursday December 25, 2025 @11:08PM (#46389147)
Oh gosh, not that legacy "hand rolled code"
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by hhh on Friday December 26, 2025 @03:20AM (#46390272)
yes, in an industry that has rapidly changing features and 7000 of these products that splinter and lose user base so quickly you should write your own orchestration for this stuff. It’s not hard and gives you a very easy path to implementing new features or optimizations.
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by never_inline on Friday December 26, 2025 @08:48AM (#46391937)
Have you heard of `def`?
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by gcr on Friday December 26, 2025 @10:12AM (#46392808)
It was an earnest question. I didn’t intend to be sarcastic.
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by alzoid on Friday December 26, 2025 @11:38AM (#46393633)
I went through evaluating a bunch of frameworks. There was Langchain, AG2, Firebase Gen AI / Vertex / whatever Google eventually lands on, Crew AI, Microsoft's stuff etc.

It was so early in the game none of those frame works are ready. What they do under the hood when I looked wasn't a lot. I just wanted some sort of abstraction over the model apis and the ability to use the native api if the abstraction wasn't good enough. I ended up using Spring AI. Its working well for me at the moment. I dipped into the native APIS when I needed a new feature (web search).

Out of all the others Crew AI was my second choice. All of those frameworks seem parasitic. One your on the platform you are locked in. Some were open source but if you wanted to do anything useful you needed an API key and you could see that features were going to be locked behind some sort of payment.

Honestly I think you could get a lot done with one of the CLI's like Claude Code running in a VM.

Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by never_inline on Friday December 26, 2025 @11:48AM (#46393741)
Which abstractions in langchain do you find so useful which require significant code to replicate yourself in functions with OpenAI SDK / LiteLLM?
Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by int_19h on Saturday December 27, 2025 @04:29AM (#46400468)
For what LangChain does, yes, handrolled code. There won't be much of it because it doesn't actually do all that much.

As for "import openai", that's actually somewhat orthogonal, but if what you want is a common API for different providers then there are many options around that do just that. But then again at that point you probably also want something like OpenRouter, which has its own generic API.

Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by jmogly on Sunday December 28, 2025 @04:49AM (#46409829)
I’ve been using the following pattern since gpt3, the only other thing I have changed was added another parameter for schema for structured output. People really love to overcomplicate things.

class AI(Protocol):

def call_llm(prompt: str) -> str: …

Re:All I Want for Xmas Is Your Secrets: LangGrinch Hits Lang... by phyzome on Friday December 26, 2025 @12:16AM (#46389404)
Huh, kind of sounds like they used LLMs to design it. :-)