News for hackers. Stuff that matters.
Re:Don't fall into the anti-AI hype by XenophileJKO on Monday January 12, 2026 @02:35AM (#46585277)
I'm not going to argue about how capable the models are, I personally think they are pretty capable.

What I will argue is that the LLMs are not just search engines. They have "compressed" knowledge. When they do this, they learn relations between all kinds of different levels of abstractions and meta patterns.

It is really important to understand that the model can follow logical rules and has some map of meta relationships between concepts.

Thinking of a LLM as a "search engine" is just fundamentally wrong in how they work, especially when connected to external context like code bases or live information.

Re:Don't fall into the anti-AI hype by lxgr on Monday January 12, 2026 @03:07AM (#46585458)
A sufficiently advanced search engine might actually be indistinguishable from intelligence.

After all, until quite recently, chess engines really were quite mechanically search engines too.

Re:Don't fall into the anti-AI hype by XenophileJKO on Monday January 12, 2026 @04:28AM (#46586070)
I'm just saying you are doing a dis-service to yourself if that is your mental model on how current SOTA models work.
Re:Don't fall into the anti-AI hype by gf000 on Monday January 12, 2026 @03:45AM (#46585751)
Well, it's "a search engine that applies some transformations on top of the results" doesn't sound to me as a terrible way to think about LLMs.

> can follow logical rules

This is not their strong suite, though. They can only follow through a few levels on their own. This can be improved by agent-style iterations or via invoking external tools.

Re:Don't fall into the anti-AI hype by XenophileJKO on Monday January 12, 2026 @04:30AM (#46586086)
Let's see how this comment ages why don't we. I've understood where we are going and if you look at my comment history. I have confidence that in 12 months time. One opinion will be proved out with observations and the other will not.
Re:Don't fall into the anti-AI hype by gf000 on Monday January 12, 2026 @08:26AM (#46588170)
For the "only few levels" claim, I think this one is sort of evident from the way they work. Solving a logical problem can have an arbitrary number of steps, and in a single pass there is only so many connection within a LLM to do some "work".

As mentioned, there are good ways to counter this problem (e.g. writing a plan and then iteratively going over those less-complex ones, or simply using the proper tool for the problem: use e.g. a SAT solver and just "translate" the problem to and from the appropriate format)

Nonetheless, I'm always open to new information/evidence and it will surely improve a lot in a year. As for reference, to date this is my favorite description of LLMs: https://news.ycombinator.com/item?id=46561537