News for hackers. Stuff that matters.

procha

LLMs Are Great, but They're Not Everything

Three years after ChatGPT’s release, LLMs are in everything—demos, strategies, and visions of AGI. But from my observer’s perspective, the assumptions we’re making about what LLMs can do seem to be drifting from architectural reality.LLMs are amazing at unstructured information—synthesizing, summarizing, reasoning loosely across large corpora. But they are not built for deterministic workflows...

( Read More... | 2 comments | 2 points | on HN )
Re:Claude's system prompt is over 24k tokens with tools on Wednesday May 07, 2025 @12:36PM (#43917811)
exactly on point, It seems paradoxical to strive for a form of intelligence that surpasses our own while simultaneously trying to mold it in our image, our own understanding and our rules,

we would be listening not directing.

Re:Claude's system prompt is over 24k tokens with tools on Wednesday May 07, 2025 @09:56AM (#43915756)
That's an excellent analogy. Also, if the fundamental nature of LLMs and their training data is unstructured, why do we try to impose structure? It seems humans prefer to operate with that kind of system, not in an authoritarian way, but because our brains function better with it. This makes me wonder if our need for 'if-else' logic to define intelligence is why we haven't yet achieved a true breakthrough in understanding Artificial General Intelligence, and perhaps never will due to our own limitations.