News for hackers. Stuff that matters.
Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by elvis10ten on Saturday November 14, 2026 @03:21AM (#50495156)
> Maybe the code is crap, who knows? I don’t look at it

I implore you to look at it! I recently vibed too close to the sun: I knew at a high-level what I was doing, but never looked at the code.

Two weeks after and 50k LOC, I’m having a look and I can’t believe my eyes. There are whole failure modes that don’t need to exist. Moreover, how can I sale this software in good faith, when something happens and I’m largely a meat proxy because I don’t know how the code works?

I will go through the entirety of the code with my naked eyes, and make improvements (with AI).

But this time, I won’t fall for the illusion of “productivity”.

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by whatisthiseven on Saturday November 14, 2026 @04:30AM (#50495489)
Looking really isn't necessary.

If you get into the regular habit of having the LLM look for issues with the code base it will find them: structural, bugs, design pattern issues, duplicate code, or same functionality not sharing a single path.

Honestly it feels like working with a real codebase. Tech debt always builds up, and yes the AI does it, too. It does notice if you ask to look.

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by elvis10ten on Saturday November 14, 2026 @06:02AM (#50496006)
I do this, but it’s a constant loop of liability.

When I wrote features by hand, I used to have like 2-5 bugs. Most of which were just human clumsiness.

When I started using AI and remained in the driving seat, most of the human clumsiness bugs went away.

Now, when I vibe, all I have are my verification loops and asking Opus5.5 to find and fix bugs.

Opus tells me it’s done. Only for me to start a new loop and it finds 10 more things or maybe I go in myself and it says “oh you are right”.

For me, this is not progress. I would rather spend an extra 1 or 2 hours a day in the driving seat building software that is correct and that is so simple that cost of changes is low.

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by elvis10ten on Saturday November 14, 2026 @06:08AM (#50496028)
Also, LLMs don’t typically know when they are climbing a local-maxima. They would add a shit ton of changes to improve the things that you measure, while other aspects suffer.
Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by troupo on Saturday November 14, 2026 @06:27AM (#50496144)
> having the LLM look for issues with the code base it will find them:

It wrote them to begin with. Now you're handing of this discovery to literally the same LLMs that wrote this.

Oh, they will find some issues. Are you sure they will fix them and/or rewrite them without introducing more issues? How do you know if "looking is not necessary"?

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by whatisthiseven on Saturday November 14, 2026 @07:37AM (#50496555)
I know it isn't necessary because 6 months ago it became largely redundant for me to look: there wasn't enough for me to criticize.

I have automated the entirety of testing and Claude can validate it's own inputs. I then focus on marking requirements fulfilled, or bugs found. The bugs it does find are usually on the side of incomplete requirements. The few technical ones were due to a lack of testing. And I am not perfect, so I would have made all kinds of bugs myself.

If you keep to a mindset of, and build processes for, the management of software development rather than coding, results are better. No this isn't a magic prompt like "make no mistakes".

It is approaching the project with the mindset of knowing the limitations of the tools like one would a junior/mid engineer, and then mitigating. This is dependent on the codebase, product, and desired requirements for what processes to use and to what degree.

If you find yourself still needing to look, you have insuffiently automated the creation and validation of written software.

Its solved. Adapt and learn to use them effectively or get left behind; seems to be the unfortunate reality.

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by skydhash on Saturday November 14, 2026 @09:42AM (#50497398)
A lot of statements with no evidence to back them. I won’t ask for a link. But did you measure the bugs (reported by customers) and the time taken to fix them, feature usage,… Or is it self patting in the back with LoC and PR counts?
Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by whatisthiseven on Saturday November 14, 2026 @12:19PM (#50498743)
Yes, an entire codebase written prior to AI existing has been made far better. More features that players report work (and I play it myself). Far more performance in a measurable way that is obvious to me and players. It can support larger maps, while running well in excess of 120fps when prior it couldn't get past 20fps. This was multiple performance issues that needed resolving. Not once did I look at the solutions that improved performance. I had Claude do byte and object level comparisons between versions to catch regression. I then played it myself to much joy.

When I release features, players report minor bugs, which I can fix in minutes by simply dumping their complaint into claude.

I worked on this codebase prior to LLMs and made slow progress, with many bugs. I did not know how to approach the performance problems, nor was I able to refactor the project to effectively have test and production environments reproducible. Claude did just fine.

It is 350k LoC, with over 138k as an Elixir app, 60k in tests/scripts, 65k Vue components, 45k JS, and more.

Coding is solved. Many people can't manage software engineering effectively. I don't know how much larger or how much more comparison is needed before this is accepted. Maybe it is "circular" reasoning like the dead comment says.

But it literally just works for me.

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by zeroc8 on Sunday November 15, 2026 @04:40AM (#50505454)
It works for me too. And I am keeping things very simple. Tell it what to do next. Check result. Rinse and repeat until I'm happy with the outcome. I do check the code diffs in produces, but only to get a rudimentary idea what it did. The results speak for themselves.
Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by troupo on Saturday November 14, 2026 @01:27PM (#50499441)
> Its solved. Adapt and learn to use them effectively or get left behind; seems to be the unfortunate reality.

Every time. Every single time. People who say they never look at code anymore always say the trite things about "management of software development", how they have no issues, and that if you have issues, it's the problem with your skills with a side of snide remarks about your intelligence.

And then you press them for details.

After a few rounds of more and more trite answers they either go away or it turns out that their "automated everything" and "processes" and "coding is solved" are:

- a bunch of "make no mistakes" aka untold numbers of random markdown files aka skills, "guidelines", "memories", "ADRs", "technical docs" etc. Which are routinely ignored by any and all models.

- a bunch of tools that can't or don't catch all the mistakes the models routinely make. E.g. there are very few tools that reliably detect code duplication (especially code duplication with subtle changes in behavior), or reliably detect bad data access patterns, or reliably detect suboptimal algorithms etc.

- an overreliance on tests. The very same tests that are written by the very same very models

---

As a related aside.

I have multiple tools from linters to semantic analysis running as routine checks, and still. Here are the responses by Claude for some of the things I caught it doing in just the past few days:

- "The [test data] generator can sometimes fail, and create duplicated data, so I increased the number of times it runs to 100" (instead of fixing it)

- "The tests check this in an indirect way. They send megabytes of data and watch the memory of the whole VM. Unrelated processes change that number. The direct check is the number of body bytes that the server read. Do you want me to rewrite these tests" (Claude wrote all these tests to begin with)

- "The previous research covered only a few CSS files. It did not cover the design system documents, the components, or the pages that already use them." (so much for "No this isn't a magic prompt like 'make no mistakes'" as it had an explicit requirement to use the design system)

- "The too_large_message/1 helper has three copies, two of them private, with no good reason for them..."

And that's just some I documented for myself.

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by whatisthiseven on Saturday November 14, 2026 @04:48PM (#50501269)
Read here for a summary of the codebase: https://news.ycombinator.com/item?id=50498743

I don't use memories, markdown files, guidelines, etc.

I design the software like I would as an principal engineer and dictate the high level requirements. Opus 5.5 really does just work. 10 months ago this wasn't quite true, it required more steering of the technical requirements.

I don't know why your results are different. I run a live multi-week long campaign game that streams updates over WSS from an Elixir app. I can literally see if Claude is doing as it claimed. It is trivial to verify when it gets it wrong.

I dunno what everyone else is using to get such poor results.

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by troupo on Saturday November 14, 2026 @05:06PM (#50501457)
> Read here for a summary of the codebase: https://news.ycombinator.com/item?id=50498743

It doesn't have a summary of the codebase. Or at least a useful summary.

> I design the software like I would as an principal engineer and dictate the high level requirements

Let me quote myself:

--- start quote ---

And then you press them for details.

After a few rounds of more and more trite answers...

--- end quote ---

This is now your third reply with trite answers (two to me and one to a sibling comment).

> I don't know why your results are different.

Because I actually look at code it produces.

> It is trivial to verify when it gets it wrong.

Yes. Yes it is.

E.g. in my codebase it is trivial to verify that it does 15 reads from the database on a page when just 2 or 3 would be enough. How do I know it? I check the logs, or see it in the REPL (I also use Elixir).

It's also trivial to see when it does shit like "oh I didn't read the design system". Because I actually see what it's doing.

It's trivial to see a bunch of other issues it routinely produces because tools like these exist: https://github.com/elixir-vibe/ex_dna and https://github.com/Cinderella-Man/credence (or even my own vibe-coded https://github.com/dmitriid/llamex and https://github.com/dmitriid/ex_css_analyzer)

> And if 350k LoC isn't enough for your use-case. Well, that wasn't quite achievable 12 months ago, but it was 8 months ago. In another year, I imagine if my codebase grew to 1M+ LoC, the latest models would still be keeping up.

Yeah yeah. "Keeping up". Where by "keeping up" you mean "I duplicated the code 15 times, and "I didn't read even half of what is needed to do this task".

It works for you because you give it only the most superficial tests. Wouldn't surprise me if you can cut all of that code in half and raise the fps 5-fold. But for that you actually have to look at the code.

----

BTW lol at the tests. Literally 10 minutes ago it produced this amazing test: https://x.com/dmitriid/status/2121723533567115357

I mean. Nothing wrong with it is there? The code works. I can see it work in my browser. What other checks do I need lol.

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by whatisthiseven on Saturday November 14, 2026 @07:27PM (#50502615)
> This is now your third reply with trite answers

Have a fourth, then.

I hope you continue to ship for use-cases your users care about in your work, and continue to find satisfaction in software engineering.

I am.

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by troupo on Sunday November 15, 2026 @06:31AM (#50506123)
Yup. As trite as before.

All I can say is: there's a reason your software had multiple performance issues, couldn't support larger maps, and couldn't get past 20fps. It's the same reason why you're so impressed with the results and don't look at code anymore.

Adieu.

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by bigstrat2003 on Sunday November 15, 2026 @01:15AM (#50504454)
> I know it isn't necessary because 6 months ago it became largely redundant for me to look: there wasn't enough for me to criticize.

Every model, including $latest_model, makes mistakes and hallucinates things. If you aren't looking at the code, you are producing bad software, end of story.

> Its solved. Adapt and learn to use them effectively or get left behind; seems to be the unfortunate reality.

Ah, there's the FOMO push. It just isn't an AI bro post without false claims of "you're going to be left behind!".

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by shinycode on Saturday November 14, 2026 @04:32AM (#50495506)
I’m shipping more code in a week than I ever did in a year. It’s impossible to read it all. But I agree that there is critical paths to analyze and decisions that are taken without our consent. I ask the agent to document every decision he makes without my consent and write it in the PR content when he’s done. Context, ADR, rules etc makes the agent quite good at following good practices but it’s a lot of work and reviews first to build and maintain the feedback loop. Good tests help also to avoid reading code. But once in a while it’s important to read critical paths to fix deviations.

What I’m most anxious about is that, because I don’t read code, if I don’t have access to an agent for any reason I’ll have a hard time fixing a critical bug because I don’t have a mental model anymore of how things work. And that’s not professional and I can’t sell that software.

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by srdjanr on Saturday November 14, 2026 @04:52AM (#50495618)
How could you not have access to an agent that's good enough for an emergency fix? Even open source models should be good enough if OpenAI, Anthropic and Google models are all unavailable, and open source models have plenty of hosts.
Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by jghn on Saturday November 14, 2026 @09:09AM (#50497156)
> ’m shipping more code in a week than I ever did in a year.

I think this is a growing problem. I pulled back. I'm much faster than I used to be. BUT, I also forcibly insert myself into the loop. I've thoroughly iterated on a design with the LLM before starting. I've personally looked at and often iterated on every line of code before merging. I regularly walk through the generated code base, both with and without LLM assistance, in order to ensure I have a solid mental picture of what's there.

This behavior has been informed by seeing things go to hell, both for myself and with other people, clients, open source projects, etc

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by cedarbyte482 on Sunday November 15, 2026 @02:59AM (#50504979)
You could consider a framework like zeroshot
Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by chamomeal on Saturday November 14, 2026 @05:37AM (#50495869)
My main issue isn’t even the code quality. It’s that the more I vibe a codebase, the less ideas I have about how to improve it and extend it.

When you have a deep understanding of something, you just can’t help thinking about all the ways you could improve it. Maybe you realize it could be generalized, or that a different problem you’ve had could be solved with a similar technique. Sometimes you get oh “OH DUH” moment where you realize you were making the slightly wrong thing this whole time, and NOW you know EXACTLY what to make.

With LLMs I just get basically what I asked for, and then I’m done. Obviously this is sick and I love it.

But for a lot of my projects recently, I fall into this trap

- I have a problem, I think a program could help. But I want to know if there’s a viable approach before I invest a bunch of time by myself, so I boot up claude

- LLM writes the entire program, I don’t know what’s going on in there

- the program kinda solves the problem or it doesn’t. At this point I already have something that has vaguely confirmed or denied the viability of solving the problem, so I think “welp I’m not gonna spend a whole week of my life reading an LLMs output”, and that’s that

I rarely have cool insights about the problem after that. In the olden days, even if my approach didn’t work, I would come away with a new understanding of that problem, and all similar types of problems. “Oh that’s why people say cache invalidation is unsolved”. “Oh that’s why generics can’t infer xyz”

Don’t really get that when you vibecode. But the siren song of just having something that works is so sweet, and I can never ever resist it

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by elvis10ten on Saturday November 14, 2026 @06:15AM (#50496062)
> the less ideas I have about how to improve it and extend it.

This! Especially this! is the real reason I started building my own commercial software again.

I’m betting that the details will still continue to matter.

Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by rererereferred on Saturday November 14, 2026 @07:22AM (#50496471)
Sell it as if you were Ikea selling furniture, not a craftsman selling furniture.
Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by elvis10ten on Saturday November 14, 2026 @08:25AM (#50496830)
Ahaha! At that point, I would rather just start making actual furniture! It wouldn’t have the same risks and I can live with myself.
Re:Jonathan Blow – If AI Solved Coding, Why Is My Software S... by KellyCriterion on Saturday November 14, 2026 @07:25AM (#50496482)
>I implore you to look at it!

Absolutely true! Some month ago I discovered huge memleaks by coincidence because Opus nailed tons of LINQ calls together and duplicated data as hell.