News for hackers. Stuff that matters.

The Limits of Today's AI Systems

Recently, I’ve increasingly come to believe that intelligence is no longer AI’s bottleneck. The systems we build around it are. Input Paradox (1) The first issue is the input paradox. When interacting with AI, if the prompt is highly detailed, the model tends to overfit to the user’s framing and assumptions. If it is too concise, the model lacks the context needed to generate something truly useful. This creates a paradox: to preserve the model’s independent reasoning, you should say less — but to make the answer specific to your situation, you must say more. Information Asymmetry (2) In economics, information asymmetry describes a situation where one party has access to critical information that the other does not. This is exactly what happens when we interact with LLMs. The user holds the high-resolution, real-world data — revenue numbers, funding status, team structure, individual capabilities, product details, operational constraints. The model sees only what fits inside a prompt. Imagine asking an NBA coach how to become a better basketball player, but the coach knows nothing about your goals, training history, strengths, or weaknesses. The advice will naturally sound broad — “practice more,” “improve fundamentals.” That does not mean the coach lacks expertise. It means the coach lacks information. The Hidden Cost of “Smart” Tools (3) Systems like OpenClaw and Claude Code are impressive, but if you inspect their logs, even simple tasks often rely on massive preloaded system prompts and large context windows. A trivial request can consume tens of thousands of tokens. This makes advanced agent systems expensive and sometimes inefficient. It raises a deeper question: are we actually building smarter systems — or just wrapping enormous static prompts around powerful models and branding them as innovation?

Some Personal Thoughts on the Future (+) We have seen the rapid advances in model capability, but the dominant interaction paradigm is still the same: text chat. We know AI is powerful, but we don’t experience it as something tangible. The future of AI agents will not be a single assistant. It will be a lot of them living inside your computer, securely accessing your data, continuously active, and continuously updating. Instead of hiding behind a chat window, they will exist within a more transparent interface — one where you can clearly see, live and work with them directly. P.S. AI companies should seriously consider collaborating with the game companies. The next interface breakthrough may come from interactive worlds.

( 2 comments | 2 points | on HN )
Re:The Limits of Today's AI Systems by jlongo78 on Thursday March 05, 2026 @03:00PM (#47266516)
totally agree. today's AIs miss context and continuity. ever tried juggling multiple agents in a session? chaos, right?
Re:The Limits of Today's AI Systems by jseabra on Tuesday March 10, 2026 @04:34PM (#47328477)
The information asymmetry framing is the most useful part of this. But I'd push back on where you locate the problem. It's not really a paradox, it's a design failure. The prompt-as-interface forces users to encode what they know into natural language on the fly, which is lossy and inconsistent. The solution isn't better prompting or bigger context windows. It's structured context gathering before inference. Interview the user systematically, build a high-resolution data model upfront, then let the model work against that. The quality difference is significant. I've spent the last year building AI systems that do exactly this. Not chat, but structured intake flows that front-load the information problem. The outputs are categorically different from what you get in a back-and-forth chat session. Not because the model is smarter, but because it's better informed. The NBA coach analogy holds: give the coach a 30-minute intake session before the first lesson and suddenly the advice stops being generic. On the agent systems critique, fair, but I'd separate two things. Token cost is an engineering problem, solvable with better retrieval, caching, compression. The "just a big system prompt" criticism is more interesting. Some of what gets marketed as agentic is basically dressed-up RAG. The genuinely agentic stuff, dynamic tool use, multi-step reasoning with actual state, is meaningfully different. The problem is the category is polluted by hype. The game interface idea is interesting but I suspect the real bottleneck isn't visual metaphor. It's persistent memory and reliable state management. Fix those and the interface question mostly solves itself.