News for hackers. Stuff that matters.
Re:How to Make Almost Anything by alex_smart on Monday November 16, 2026 @06:24AM (#50516366)
Isn’t the LLM already better at broadly knowing everything that exists than any human could ever hope to be?
Re:How to Make Almost Anything by qalmakka on Monday November 16, 2026 @06:28AM (#50516384)
yep, but it's not better at picking strong, long term decisions in my experience. The LLM most of the time is like a very knowledgeable employee that just does what it's told, and if the boss doesn't understand that you can do something, will often not ask for it to begin with.

for instance, if you use a shitty library X in a project, and you ask your frontier model "please change A -> B" the model will just do that, it will not tell you "well maybe you could also swap the whole thing with Y" because that's not its job - it's job it to change A to B.

Re:How to Make Almost Anything by skeptic_ai on Monday November 16, 2026 @06:49AM (#50516550)
That’s why you just ask: do you think this is a good idea? Correct me if I’m wrong
Re:How to Make Almost Anything by wolttam on Monday November 16, 2026 @06:51AM (#50516573)
So all it takes is asking broad “hey LLM, is there any obviously better approach to what we’re doing?” Questions once in a while.

(I agree, they may not be good at making strong long-term decision still, but that may also be an issue of inadequate context a lot of the time)

Re:How to Make Almost Anything by roveo on Monday November 16, 2026 @06:40AM (#50516481)
LLMs currently are a great demonstration of the wide difference between knowing things and applying them in practice. Knowledge contained in LLMs is vast, but latent.

Humans have a practically infinite "context window" (active memory), we make associations and vaguely remember that thing we heard about that might be useful here, let's explore this thread ("you're absolutely right!"). Agents, being powerful as they are, don't do that, they pattern-match on the task and use the obvious solution, but don't activate their latent knowledge until you point them in the right direction.

The obvious solution might be the best one in 80% of cases or if you don't really care to get the best results (and it's absolutely fine!), but if you do care in your particular case, you have to babysit your agents and really understand if they're doing what you had in mind.

Re:How to Make Almost Anything by PaulRobinson on Monday November 16, 2026 @07:21AM (#50516829)
I’d say a SOTA LLM today has median depth of expertise over many, many disciplines, and slightly better than median expertise in a few key areas. “Jack of all trades, master of none”, springs to mind, but I’d say in the last 6 months it’s got above the median in some key areas.

The sweet spot is a true expert in a domain driving the LLM and keeping it honest, whether that be via agents/skills or reviewing work. In software dev, there’s huge tranches of work at junior/mid level where LLMs can just go, and anything where there is a clearly testable goal it can iterate on faster than a human expert, for example recent progresses in maths proofs.

But, I don’t think there’s an LLM out there that is an expert at everything. At least, not yet.

Re:How to Make Almost Anything by epiccoleman on Monday November 16, 2026 @11:53AM (#50519737)
It's funny because - yes, it does seem like it should be that way. But I feel like a huge amount of the value I've gotten from LLMs has been specifically because I'm a generalist type and I can sort of quickly cut through the space of possibilities.

Just knowing what's possible, having been exposed to a bunch of ideas, libraries, tools, and, yes, reading too much Hacker News - seems like it's allowed me to ask good questions, propose interesting experiments, and drive my own knowledge forward faster with LLMs.

I don't know that it's a particularly unique skill, but from personal experience there seems to be a spectrum of ... creativity? Freedom of thought / expression? And people who are kinda stuck in their ways seem to get less out of LLMs than people who have some idea of what they want and even some direction in mind, but just need the details made frictionless.

I think I'm not doing the best job expressing what I'm on about, so here's an example - I have a little livecoding app[0], which I developed (vibe-coded) for a conference talk I gave in October[1]. It's been a lot of fun to play with and has formed a good surface for lots of different experiments that never made it into the codebase - just throwaway ideas, etc.

So when all the hype about Jev was going a month or two ago, my experiment was "can Jev sit in on the jam?" And what I did was hook it up to the app - not to the "musical context" information that other agents (agents in the Elixir sense, not really the 'llm agent' sense) in that app receive, but rather to the raw signal info that was coming out of the master audio node. And then Jev made a prediction about what note to play, and then that note was sent through WebMIDI to a VST on my machine so that Jev was almost like an outside "guy" soloing over the app's music.

(Jev was a pretty boring soloist, because playing the "most likely" note every time is not especially exciting, but that's beside the point here).

Maybe Claude / Codex could have come up with that idea without me - surely the models know about all of those different tools / options already. But I'd bet that if I hadn't known what to ask for, I'd have gotten something less fun.

So, idk. Does that mark me out as some kind of special generalist who will forever be ahead of the permanent underclass because he reads too much HN? Probably not. But it's at least a useful disposition in the LLM era.

[0]: https://github.com/epiccoleman/tripulator/ (AGPL, go nuts!)

[1]: https://epiccoleman.com/tripulator