News for hackers. Stuff that matters.
Re:AI is forcing us to pay off 40 years of technical debt by Arbortheus on Wednesday November 04, 2026 @07:17AM (#50364549)
I hope some of these backdoors and/or 0-days being kept under wraps by nation states or corporate espionage companies (Pegasus et al) are being found incidentally through all this.

It’s frustrating to have all these 0days and CVEs to patch for now, but in the long run perhaps we’ll leave with more robust software.

Re:AI is forcing us to pay off 40 years of technical debt by syshyk on Wednesday November 04, 2026 @07:18AM (#50364564)
Hopefully we'll also see us back to KISS principles too. But who am I kidding
Re:AI is forcing us to pay off 40 years of technical debt by bunderbunder on Wednesday November 04, 2026 @07:54AM (#50364885)
Could the global economy survive what that would do to the B2B SaaS industry?
Re:AI is forcing us to pay off 40 years of technical debt by throw938990 on Wednesday November 04, 2026 @07:56AM (#50364900)
Plain http 1.0 is KISS. Does not really work that well.
Re:AI is forcing us to pay off 40 years of technical debt by mhluongo on Wednesday November 04, 2026 @08:06AM (#50365024)
Systems should be made as simple as possible, and no simpler.

That doesn't mean every simple system solves the problems we intend for it to solve. It means that all else being equal, we should prefer parsimony.

Re:AI is forcing us to pay off 40 years of technical debt by Ekaros on Wednesday November 04, 2026 @08:02AM (#50364970)
What I have heard from AI it is anything but KISS... More features and more code as fast as machinelly possible.
Re:AI is forcing us to pay off 40 years of technical debt by Imustaskforhelp on Wednesday November 04, 2026 @08:05AM (#50365008)
Depends on your incentives, most people and companies are measuring Lines of codes and features as the metric so ofc it will increase it, but AI can create small KISS applications. It might have a little difficulties in doing so sometimes because it sometimes likes to overengineer things but I have to wonder how much of it is because it is RLHF'd to solve questions at any costs in terms of lines of code rather than training it in solving it in KISS principles. Also I wonder how AI will perform if we explicitly treat KISS as the only principle and have checks running on it and have it discard all the code which wouldn't follow KISS principle if it doesn't follow the principle.
Re:AI is forcing us to pay off 40 years of technical debt by sam_lowry_ on Wednesday November 04, 2026 @08:15AM (#50365117)
Dunno about your company, mine measures in lines of code removed.
Re:AI is forcing us to pay off 40 years of technical debt by layer8 on Wednesday November 04, 2026 @09:26AM (#50365977)
> have checks running on it

We don’t have effective objective measures of what would constitute KISS.

Re:AI is forcing us to pay off 40 years of technical debt by aruametello on Wednesday November 04, 2026 @08:30AM (#50365274)
> ... More features and more code as fast as machinelly possible.

i am going to quote that a lot...

Re:AI is forcing us to pay off 40 years of technical debt by waffletower on Wednesday November 04, 2026 @11:48AM (#50368249)
I think 'clankerly' has a better ring to it.
Re:AI is forcing us to pay off 40 years of technical debt by eithed on Wednesday November 04, 2026 @09:16AM (#50365847)
People complain about LLMs not respecting KISS, but fail to address why = LLMs being defensive and coding for situations that either do not happen or are unlikely to happen. That doesn't absolve you from deciding using your human brain if given change makes sense or doesn't. You can also tell LLMs to not program defensively.

Same with any other acronyms - if you don't set up guardrails on when given principle should apply you'll get code that you can only complain about.

Re:AI is forcing us to pay off 40 years of technical debt by layer8 on Wednesday November 04, 2026 @09:23AM (#50365940)
> coding for situations that either do not happen or are unlikely to happen.

Not coding for situations that “do not happen” is exactly what creates vulnerabilities. But I also don’t think that such code is the main source of complexity in LLM-generated code.

Re:AI is forcing us to pay off 40 years of technical debt by eithed on Wednesday November 04, 2026 @09:37AM (#50366114)
An example to what I'm talking about: I have application that takes two inputs from request. I've put in validation on request values to deny values that are greater than 100. In my code I'm adding these values. LLM can say "cater for addition of these two numbers, because they might go over MAX_INT". This is a situation that won't happen. LLM can recommend - add assertions. That's unnecessary.
Re:AI is forcing us to pay off 40 years of technical debt by layer8 on Wednesday November 04, 2026 @09:45AM (#50366243)
Arguably it’s only unnecessary when the value range is enforced by the programming language (types). The structure of who calls what in the code can change, and suddenly larger values can appear. You don’t want to have to perform whole-program analysis on every change to check whether all assumptions made in the past still hold. That’s also a source of vulnerabilities: assumptions that held when the code was written, but stopped holding sometime later.

That’s why I think code needs to document all its assumptions, and in a way that is checked by the compiler to the extent possible. If you document that the values have restricted range, then the AI should take it into account.

Re:AI is forcing us to pay off 40 years of technical debt by eithed on Wednesday November 04, 2026 @09:59AM (#50366474)
Types is an option. Another option would be tests (and in this case mutation testing).

My main point still stands = LLMs code defensively catering for unknowns that are not loaded into context.

Re:AI is forcing us to pay off 40 years of technical debt by Orphis on Wednesday November 04, 2026 @12:00PM (#50368422)
And the day you add a way to batch import request through another code path, you may forget the validation.

Having it in the lower layer is correct, a proper optimizing compiler should be able to detect there's a single code path to the function and that the checks have already been done, skipping the second check.

Re:AI is forcing us to pay off 40 years of technical debt by eithed on Wednesday November 04, 2026 @01:40PM (#50369750)
Well - this would be an example of defensive programming and by that logic catering for this "what if" is the way to go. LLMs were correct all along!
Re:AI is forcing us to pay off 40 years of technical debt by alright2565 on Wednesday November 04, 2026 @06:24PM (#50372850)
Alternatively, the code could be written in the style of parse, don't validate[1]. However I've never had a coding LLM preemptively suggest that.

[1]: https://lexi-lambda.github.io/blog/2019/11/05/parse-don-t-va...

Re:AI is forcing us to pay off 40 years of technical debt by ShadowOfThePit on Wednesday November 04, 2026 @09:59AM (#50366485)
I vibe-slopped a small and local forms application for my family. I explicitly mentioned that fact to the LLM.

Yet, I removed 2/3s of the code, because it checked every file if it REALLY exists, that the input form was less than a million bytes in size, that there were propper HTTP status codes for everything, and that every possible error from reading data was eagerly checked and caught.

Like come on! Less than five people will ever look at it! They aren't going to try to exploit it!

Re:AI is forcing us to pay off 40 years of technical debt by lilbigdoot on Wednesday November 04, 2026 @11:40AM (#50368135)
Idk I routinely see the LLMs repeat validations that already happen in another layer or it imagines things that don't exist
Re:AI is forcing us to pay off 40 years of technical debt by bunderbunder on Wednesday November 04, 2026 @11:26AM (#50367913)
My complaint is that LLMs’ approach to making code robust is something we used to pejoratively describe as “enterprisey”.

Oftentimes there are two broad ways to fix a gap in the logic. You can eliminate the source of it, which often involves refactoring but tends to result in less code and cleaner, more comprehensible logic. Or you can leave the gap there, but attempt to render it safe by adding extra logic to detect and handle the error condition. This reduces changes to existing code, but makes the overall system more complicated.

You can’t just indiscriminately favor one approach. Which one of those is best depends on the situation. The deciding factor is often something like a time constraint that you can’t know just by reading the code. You might need to talk to your team before deciding.

But LLMs don’t do that. They always choose option B: slap a bandage on it. Keep on adding more epicycles. In the 2000s we learned that, over time, always choosing this approach inexorably leads to codebases that are brittle, bloated and expensive to maintain.

So the problem, from my perspective, isn’t that we shouldn’t be coding defensively. It’s that LLMs encourage us to do it in a way that we’ve already learned is unsustainable.

Re:AI is forcing us to pay off 40 years of technical debt by eithed on Wednesday November 04, 2026 @11:40AM (#50368143)
Agree. It should fall on to developers to decide what to do = whether tackling tech debt is viable solution (whether making decision on their own or talking to people that can make such decision) or not. If, however, you're told "here is a codebase that you're seeing for first time, fix this error" and you simply cannot make the decision, even prior to LLMs you'd put a bandaid on it. Or at least - that's the standard approach = fix now, refactor later, where later in my experience never happens (sorry for this train of thought).

I don't think this is anything new, nor LLMs are to blame here

Re:AI is forcing us to pay off 40 years of technical debt by bunderbunder on Wednesday November 04, 2026 @12:06PM (#50368503)
Agreed, it is not at all a new problem. The enterprisey codebases I’ve encountered are ones that have chronically had no clear owner, or constant ownership churn. I have been in that position before, and I also decided to make the code even more bloated for the same reason: I did not and was not going to have the time to learn the system well enough to safely do a better job.

I think where a lot of people run into problems with the KISS principle is they conflate simple and easy. More often than not, simple is hard. Which is maybe a soft reason why agentic coding, which is all about trying to make every task easy, leads so consistently to complexity and bloat.

Re:AI is forcing us to pay off 40 years of technical debt by rmunn on Thursday November 05, 2026 @08:39AM (#50378931)
Nobody else is likely to see this comment but I want to make it anyway. Yes, simple is hard. Thank you for articulating it so well.

And yes, that's also why LLM code is usually (unless driven by someone who really knows what he's doing) full of unnecessary complexity. Because although LLMs can get a much broader "understanding" of a code base than I would have given them credit for a couple years ago, their "understanding" is still shallow. And what you need to truly be able to achieve that hard simplicity (I heard someone refer to it once as "the simplicity on the other side of complexity", e.g. when Kepler figured out that orbits were ellipses, not circles, and that allowed getting rid of epicycles) is deep understanding. Which LLMs are not capable of, hence why their code is full of the kind of needless complexity that one produces when one has only a shallow understanding of the code. (E.g., you in that enterprisey codebase when you weren't going to be given time to reach deep understanding).

Re:AI is forcing us to pay off 40 years of technical debt by eithed on Thursday November 05, 2026 @01:32PM (#50382642)
I don't think I agree that simple is hard. Simple takes effort. Simple requires that you have agency. Simple has all the information available. Simple means that you're accountable for something. I'll be cynical here - it's sooooo much easier to say: this is how it was when I arrived here, it's not my problem, what will I get out of this, somebody told me to do it like this. And nothing in the above is LLMs fault! Well, unless at least now you can say - something did it like that! It's not my fault, it's what LLM told me to do.

Anyhow, apologies for being glum and straying away from the topic, but I also wanted to make a comment that is unlikely to be seen :) the bile comes from personal experience and is not directed towards anyone

Re:AI is forcing us to pay off 40 years of technical debt by rmunn on Thursday November 05, 2026 @06:44PM (#50386218)
When you say "simple takes effort", that's kind of what I meant by "simple is hard". It takes work, it takes looking at the problem for a long time (Kepler studied orbits for years) until you understand it well enough to have the epiphany that lets you reduce the complexity down to "oh wait, orbits are ellipses and that solves everything!". Since you preceded your statement that "simple takes effort" with a disagreement about simple being hard, I wonder what you thought I meant by "simple is hard".
Re:AI is forcing us to pay off 40 years of technical debt by zeroonetwothree on Wednesday November 04, 2026 @11:44AM (#50368190)
Very well stated
Re:AI is forcing us to pay off 40 years of technical debt by ShadowOfThePit on Wednesday November 04, 2026 @01:03PM (#50369239)
So true! And it goes hand-in-hand with a different problem: You being able to try and brute-force solutions.

If you write your prompt as a request, and not carefully as an idea or suggestion, the bot can blindly agree to 'help'. And if you are stubborn about it, you can lose hours on something that cannot work, or make the code infinitely worse.

However, it's also the path of getting better at programming. To learn to take a step back, to ask yourself if it's really sensible. Just that now it also involves questioning the bot's help, as well as writing your prompts to prevent it.

Re:AI is forcing us to pay off 40 years of technical debt by simpaticoder on Wednesday November 04, 2026 @11:46AM (#50368221)
It doesn't have to be that way. You can use llms to greatly improve the quality of the code. You do this by focusing on one part of the design use the LLM to explore alternatives, use it to poke holes in what you have. I think the engineering cultures that embrace this way of using AI will far outperform everyone else in the long term.
Re:AI is forcing us to pay off 40 years of technical debt by RHSeeger on Wednesday November 04, 2026 @12:16PM (#50368612)
I just had a discussion with the AI recently about whether to duplicate the code something used or refactor it so both places used the same code. The decision was to duplicate the code, but make notes (and a ticket) to refactor it later - because the time to test the possible regression cases of the original code wasn't available right now.

I could have worked through all that on my own, but having the AI as a rubber duck to talk to - plus the edge cases it was able to point out - was really helpful.

Re:AI is forcing us to pay off 40 years of technical debt by iamveen on Wednesday November 04, 2026 @01:51PM (#50369897)
It's funny, I've had similar conversations, where the agent would recommend the 'lazy' solution because the robust one took too long. More often than not, it was assuming human-hours of work though. Once reminded that a clanker would be doing the work it's conclusion shifted to the robust one.

Now, I wonder if it actually agreed, or if it sensed that I preferred the robust solution and was trained to make me happy.

Re:AI is forcing us to pay off 40 years of technical debt by RHSeeger on Wednesday November 04, 2026 @01:58PM (#50369996)
Yeah, I've seen that, too. In my case it was less about the dev time and more about the regression testing time (much of which would fall on QA and involved reading from external feeds, etc - so, complicated). But your point is fair. The AI is ... notoriously bad at LOE. Not that it's always wrong, but frequently enough (and by a large enough amount) that tradeoffs like that really need humans considering them.
Re:AI is forcing us to pay off 40 years of technical debt by drewbeck on Wednesday November 04, 2026 @02:40PM (#50370499)
It’s jarring when the bot tells you something will take a “week of work”. A good reminder I guess that it doesn’t have self awareness as we usually think of it.
Re:AI is forcing us to pay off 40 years of technical debt by glouwbug on Wednesday November 04, 2026 @04:32PM (#50371864)
[delayed]
Re:AI is forcing us to pay off 40 years of technical debt by keybrd-intrrpt on Wednesday November 04, 2026 @06:47PM (#50373034)
> I just had a discussion with the AI recently about whether to duplicate the code something used or refactor it so both places used the same code. The decision was to duplicate the code, but make notes (and a ticket) to refactor it later

I wonder if a refactor is even necessary.

Concepts like KISS, DRY, etc. are largely human-centric. They're meant to make code easier to write, understand, and maintain - for people.

Duplicating code was traditionally "bad" because it increased maintenance costs, risked divergence, and added cognitive overhead for human developers.

But with coding agents, some of those tradeoffs start to change. An agent can find and update duplicate implementations in seconds. It doesn't need to maintain the same mental map of a codebase that a human does.

And if we have good specifications and comprehensive tests, behavioral divergence should be detectable and correctable. In fact, duplication can offer an advantage over shared abstractions: isolation. Changes to one implementation don't risk breaking unrelated consumers of shared code, and each implementation can evolve independently.

Maybe we won't need as many high-level abstractions, or eventually even some of the architectural patterns we consider best practices today.

If the cost of writing and maintaining code approaches zero, perhaps we should optimize less for human readability and more for runtime performance, memory efficiency, isolation, and correctness.

We might even regain some CPU and memory efficiency by eliminating layers of indirection, virtual calls, and abstractions that primarily existed to make code manageable for humans.

Perhaps the optimal architecture for AI-maintained software is fundamentally different from the optimal architecture for human-maintained software.

A lot of our software engineering best practices are based on the economics/ergonomics of human maintenance. What happens when those fundamentally change?

Re:AI is forcing us to pay off 40 years of technical debt by rafaelRiv on Wednesday November 04, 2026 @07:29PM (#50373396)
> Duplicating code was traditionally "bad" because it increased maintenance costs, risked divergence, and added cognitive overhead for human developers.

Until proven wrong by coding agents, this is still the case even for agents. Not sure why you are assuming this doesn't apply for the machine

Re:AI is forcing us to pay off 40 years of technical debt by marcus_holmes on Wednesday November 04, 2026 @08:25PM (#50373842)
I cannot read a 50-page T&C document. I mean, obviously, I can physically do it, but I don't have the patience, and I'd lose track of what I'd read. Getting an LLM to summarise a 50-page T&C document is simple, it doesn't lose track, and it spits out a summary in seconds.

I cannot read a 50K LOC code base at once. I mean, obviously, I can physically do it, but I don't have the patience, etc. I need mental shortcuts like abstractions layers to hold even parts of the code base in my head. LLMs don't. They can read that in seconds and hold the whole thing in context.

Re:AI is forcing us to pay off 40 years of technical debt by gadsdengrappler on Thursday November 05, 2026 @07:26AM (#50378290)
This doesn’t really support the argument that KISS et al don’t apply to LLMs. They may not ‘need’ these principles for the same reasons as humans, but will still benefit from the context having higher information density.
Re:AI is forcing us to pay off 40 years of technical debt by keybrd-intrrpt on Thursday November 05, 2026 @12:29PM (#50381840)
> but will still benefit from the context having higher information density.

That's an assumption.

And is that what we really care about anymore? Maybe we are ok accepting some "inefficiencies" in the code for the LLM but we get better CPU utilization or cache/RAM usage

Re:AI is forcing us to pay off 40 years of technical debt by gadsdengrappler on Thursday November 05, 2026 @02:11PM (#50383098)
> That's an assumption.

So is that ;) But yeah, the link between context length and performance reduction is well researched. Automatic context management has been getting better, but it’s not a panacea, especially in very large codebases and long sessions.

> Maybe we are ok accepting some "inefficiencies" in the code for the LLM but we get better CPU utilization or cache/RAM usage

If by ‘inefficiencies’ you mean choosing hardware-friendly architectures over those that correspond to a human-friendly world model, then I would agree with you (this was already required in my domain pre-LLMs). Even still that does not stop one from adhering to DRY, KISS, etc as the abstractions required are often either free or close to free at runtime.

Re:AI is forcing us to pay off 40 years of technical debt by ern on Wednesday November 04, 2026 @06:54PM (#50373095)
>because the time to test the possible regression cases of the original code wasn't available right now.

The models don't know that they're not human when they estimate. It's worth telling them that all estimates need to be made in the context of an agentic AI doing the work.

Re:AI is forcing us to pay off 40 years of technical debt by stingraycharles on Wednesday November 04, 2026 @08:11AM (#50365074)
I may be ignorant, but what do you mean with this and why is it upvoted so much?

To me KISS is basically about how you’d write the code, the architecture, which is something that - at least currently - humans need to oversee when writing new code with LLMs.

But what does it have to do with AI discovering a ton of bugs in a lot of (open-source) software?

Re:AI is forcing us to pay off 40 years of technical debt by Tuna-Fish on Wednesday November 04, 2026 @08:17AM (#50365137)
A lot of these bugs are in rarely exercised code paths that probably shouldn't have been written into the software in the first place.
Re:AI is forcing us to pay off 40 years of technical debt by sznio on Wednesday November 04, 2026 @08:17AM (#50365142)
that people will finally start solving issues by simplifying the software rather than generating even more edge cases.
Re:AI is forcing us to pay off 40 years of technical debt by boomlinde on Wednesday November 04, 2026 @08:25AM (#50365223)
Software that does less is easier to understand and reason about, and typically requires less code. Less opportunity for bugs to appear.

Maybe, when they build a pomodoro timer, people will consider the possibility that the entirety of a browser engine as well as 30 000 javascript dependencies from random unvetted sources introduces unnecessary complexity and a practically infinitely fractal attack surface.

Re:AI is forcing us to pay off 40 years of technical debt by embedding-shape on Wednesday November 04, 2026 @12:19PM (#50368646)
[delayed]
Re:AI is forcing us to pay off 40 years of technical debt by renehsz on Wednesday November 04, 2026 @10:14AM (#50366734)
[delayed]
Re:AI is forcing us to pay off 40 years of technical debt by keybrd-intrrpt on Wednesday November 04, 2026 @06:54PM (#50373096)
> but that makes it easier than ever to inflate codebases to millions of lines of unnecessary complexity that are impossible to work with and maintain.

Impossible for you, me, and other humans maybe. But not hard to understand for LLMs

> I want to see an LLM reduce a complex multi-million line codebase to 1/10th of its size or less without breaking functionality. That would be impressive!

They can and do, if you ask them to.

If you have tests to validate functionality, it can easily reduce and refactory.

But, why are we caring about LOC again?

Re:AI is forcing us to pay off 40 years of technical debt by titzer on Wednesday November 04, 2026 @11:57AM (#50368378)
Well, with fewer architecture astronauts overdoing things, all those extra abstractions and dimensions of extensibility that never get used never get written, so one might hope the code is simpler in the long run. But right now coding agents just love writing code, and they don't have a lot of taste for boundaries and architecture, so we have the loop-unrolled, big-pile-of-ifs kind of logic that isn't good.
Re:AI is forcing us to pay off 40 years of technical debt by octoberfranklin on Wednesday November 04, 2026 @07:27AM (#50364646)
This is the real reason for the vulnpocalypse, not "technical debt".

NSA spent 20 years stockpiling vulns and pushing the industry towards half-assed solutions like address sanitization and pointer tagging when they could have put the industry on memory-safe languages instead.

They managed to get the IME/PSP/TrustZone into 99% of the CPUs out there by mandating it for government purchases; they could have done the same thing with memory-safe languages. But instead they chose to stockpile vulns. Hope they burn in hell for this.

Re:AI is forcing us to pay off 40 years of technical debt by FartyMcFarter on Wednesday November 04, 2026 @07:32AM (#50364698)
Why do you think the NSA could have put the industry on memory-safe languages?

Even if they wanted to, I highly doubt they could push the industry to do that. The industry does what it wants to do, and rewriting tons of software was far from its priorities.

There's also the fact that rewriting software tends to introduce a lot of new bugs.

Re:AI is forcing us to pay off 40 years of technical debt by lambdaone on Wednesday November 04, 2026 @07:42AM (#50364772)
The U.S. government could have required all new software for any government-procured system to be written memory-safe languages, thus making it ubiquitous. This could have been phased in slowly with a few years of on-ramp time to allow for industry to acquire the relevant skills.
Re:AI is forcing us to pay off 40 years of technical debt by terminalcommand on Wednesday November 04, 2026 @07:46AM (#50364807)
But even in memory-safe languages, compiler bugs are still an issue. The theory is perfect but the implementation is flawed. In such case once the compiler bugs are found, the software would have to be rewritten to compile. For example an 11 year old memory bug was discovered recently in the rust compiler: https://www.penligent.ai/hackinglabs/rust-borrow-checker-bug....

Memory safe languages are not a silver bullet either.

Re:AI is forcing us to pay off 40 years of technical debt by GTP on Wednesday November 04, 2026 @07:59AM (#50364938)
Definitely not a silver bullet (consider also that memory management isn'the only source for vulns), but still much better than C/C++.
Re:AI is forcing us to pay off 40 years of technical debt by dns_snek on Wednesday November 04, 2026 @01:44PM (#50369800)
[delayed]
Re:AI is forcing us to pay off 40 years of technical debt by terminalcommand on Wednesday November 04, 2026 @03:07PM (#50370796)
No, you are wrong. Rust compiler bug uncovered this month was aboıt memory safety: https://www.penligent.ai/hackinglabs/rust-borrow-checker-bug....

Basically, the borrow checker allowed writing memory unsafe programs without using the keyword unsafe.

Compilers for C, C++ etc. are well established but Rust is a relatively new language. There are many bugs to come just like this.

Using a memory safe language is not a silver bullet for writing memory safe code. The implementation of the memory safe language introduces bugs as well.

Re:AI is forcing us to pay off 40 years of technical debt by dns_snek on Wednesday November 04, 2026 @05:42PM (#50372509)
[delayed]
Re:AI is forcing us to pay off 40 years of technical debt by bluGill on Wednesday November 04, 2026 @07:50AM (#50364842)
The U.S. government had pushed Ada for years and it never worked out. The government was forced to accept C++ because industry was rebelling against ADA, even though ADA was memory safe. Well, Ada did have the ability to be memory unsafe. It was much better by default.
Re:AI is forcing us to pay off 40 years of technical debt by jazzypants on Thursday November 05, 2026 @09:52AM (#50379814)
I mean, the government could have just stopped working with those rebellious, incompetent contractors, but I guess the pork barrel was just too enticing.
Re:AI is forcing us to pay off 40 years of technical debt by elcritch on Wednesday November 04, 2026 @07:53AM (#50364870)
The DoD tried that with Ada and largely failed. That was with defense contractors whose primary customer mandated it. That was despite Ada being proven to work in its first projects.
Re:AI is forcing us to pay off 40 years of technical debt by elzbardico on Wednesday November 04, 2026 @08:14AM (#50365103)
The DoD have even created their own language: ADA. Massive contracts power, but different markets to incentivize.

The distance between the usual consumer/b2b tech startup and the kind of company that sells software to the air force is even bigger than the distance between Google and the kind of company who hires Accenture.

Re:AI is forcing us to pay off 40 years of technical debt by octoberfranklin on Thursday November 05, 2026 @09:33AM (#50379568)
Why do you think the NSA could have put the industry on memory-safe languages?

Did you even read my comment? I very explicitly answered this.

Government purchasing requirements have an immense effect on industry. IME/PSP/TrustZone have 99% CPU coverage because NSA put "owner-inaccessible oversight processor with disjoint physical address space" into federal sourcing requirements.

They could easily have done the same with "memory-safe language". Note this is not the same as "must use Ada" which is obviously dumb. The IME/PSP/TrustZone req worked so well because they specified the feature not the implementation (and indeed it has been implemented three different ways).

But instead, NSA actively pushed in the opposite direction and funded all sorts of kludges to try to keep memory-unsafe languages kicking as long as possible.

They have actively sabotaged the national security of their own country.

Re:AI is forcing us to pay off 40 years of technical debt by aa-jv on Wednesday November 04, 2026 @07:49AM (#50364839)
>IME/PSP/TrustZone into 99% of the CPUs

Yeah, about that. Its the biggest vulnerability in the industry. Nobody wants to confront this fact, though.

Too much profit to be made in in oppression/human rights abuses.

Re:AI is forcing us to pay off 40 years of technical debt by leonidasrup on Wednesday November 04, 2026 @08:48AM (#50365476)
Sometime the profit made by the companies for inserting backdoors can be quantified:

" In 2013, The New York Times reported that documents in their possession but never released to the public "appear to confirm" that the backdoor was real, and had been deliberately inserted by the NSA as part of its Bullrun decryption program. In December 2013, a Reuters news article alleged that in 2004, before NIST standardized Dual_EC_DRBG, NSA paid RSA Security $10 million in a secret deal to use Dual_EC_DRBG as the default in the RSA BSAFE cryptography library, which resulted in RSA Security becoming the most important distributor of the insecure algorithm. "

https://en.wikipedia.org/wiki/Dual_EC_DRBG

Re:AI is forcing us to pay off 40 years of technical debt by aa-jv on Wednesday November 04, 2026 @10:36AM (#50367097)
Yeah.

People seem to be fine with it as long as their own team seems to be profiting from it - but for those of us who are not subject citizens of the NSA's government, it is a truly heinous state of affairs.

Re:AI is forcing us to pay off 40 years of technical debt by hnedeotes on Wednesday November 04, 2026 @08:20AM (#50365163)
It's interesting that no-one talks about writing new systems and base languages that don't inherit anything from the current toolchain. That's the first step, then new architectures / fully open auditable hardware basis. With html you don't need any of this dependency chain. As long as you can write a browser you can be running on anything underneath.
Re:AI is forcing us to pay off 40 years of technical debt by ben_w on Wednesday November 04, 2026 @08:26AM (#50365230)
At this point, a browser is a significant part of the way to being an OS virtualised inside the OS it's really running on. Complete with occasional leaks through the virtualisation to the real host OS/machine.
Re:AI is forcing us to pay off 40 years of technical debt by hnedeotes on Wednesday November 04, 2026 @09:13AM (#50365811)
Yes, chrome for instance is more lines of code than the entirety of Linux, I think this just makes the case stronger for what I said. Although I understand why it might be so.
Re:AI is forcing us to pay off 40 years of technical debt by tremon on Wednesday November 04, 2026 @08:50AM (#50365491)
What do you mean with "don't inherit anything"? Using the existing binary ABI is mandatory for interoperability so yes, in that sense every new programming language inherits something. Other than that, there's plenty of languages that have fully self-contained toolchains and runtimes, e.g. Erlang and Rust come to mind. Guix bootstraps its entire environment from a minimal Lisp implementation. Then there's Microsoft's CLR and its entire ecosystem of programming languages, but I don't know if the runtime exists next to the Win64 C/C++ base or on top of it.

HTML is entirely the wrong comparison, as it's a document format and not a programming language, and "as long as you can write a browser" is not a simple condition. Do we have any browser (even in development) that isn't written with current toolchains?

Re:AI is forcing us to pay off 40 years of technical debt by hnedeotes on Wednesday November 04, 2026 @09:12AM (#50365793)
HTML as the "transport"/"dialect" to keep compatibility with the existing computational world. What I mean is from the ground up, no C, no erlang (which Im a big fan of in terms of application organisation), no Rust, no Javascript. Start from first principles, OS'es closer to uni-kernels, sane sharing/privacy policies, ability for instance to start an "executable" (already an abstraction tied to the current mode of software production, albeit a perhaps useful one) with a narrow set of scoped access. Then it only has to implement a browser/subset of it to parse HTML and it can "access" most of the relevant parts of the existing software world (internet). Ditch anything complex, if necessary make a browser that just uses flexbox, no other things, no backwards, compatibility, if you need compatibility buy a normal laptop with a normal OS, that comes with all the cruft, but design this new one from the ground up.

But I also don't understand why (without compatibility layers) a browser should be as complex, or remotely as complex, as currently, specially with all the knowledge in hindsight.

I'm not saying this is easy, doable, or whatever, but that was what I meant.

Re:AI is forcing us to pay off 40 years of technical debt by Zigurd on Wednesday November 04, 2026 @08:56AM (#50365571)
Well it's hard to point to a fully top bottom initiative to create new platforms from the ground up, the Chinese appeared to be making an effort to reduce their non-native surfaces with things like Harmony OS.

A complete plan to reduce vulnerability from untoward influences is more feasible now with agent assisted engineering. You have to be carefully selective about what matters and what doesn't, or the cost in time balloon out of control.

Re:AI is forcing us to pay off 40 years of technical debt by hnedeotes on Wednesday November 04, 2026 @09:16AM (#50365852)
That's also weird, in this reality, isn't it? You've got russians, chinese, etc, supposedly antagonistic to the western cultural hegemony, but then they just rely on western technology tool-chains. If I was guiding any of these countries a close to number 1 priority, technologically speaking, would be to create a completely independent software tool-chain. And talk through adaptors.
Re:AI is forcing us to pay off 40 years of technical debt by pnt12 on Wednesday November 04, 2026 @01:25PM (#50369555)
I think China uses NeoKylin, and Russia Astra Linux, both based on Linux.

I don't see China antagonistic to the west - they want autonomy, and don't share many of the values, but they're open to a wealthy West spending lots of money in Chinese goods.

Russia, at least its government, is a bit more, especially recently. But anyway, why reinvent the wheel when a battle tested FOSS is there for the taking?

Re:AI is forcing us to pay off 40 years of technical debt by stickfigure on Wednesday November 04, 2026 @12:20PM (#50368659)
> As long as you can write a browser

One does not simply "write a browser"...

Re:AI is forcing us to pay off 40 years of technical debt by InsidiousWombat on Wednesday November 04, 2026 @08:21AM (#50365176)
I'm more annoyed by the fact the fixes and exploits themselves are being artificially delayed in misguided attempts to coordinate disclosure, in world where anyone can just point AI at vague direction of the bug and just find it
Re:AI is forcing us to pay off 40 years of technical debt by lilbigdoot on Wednesday November 04, 2026 @11:48AM (#50368258)
Right, it entertaining to me to prompt an LLM with a build error or a runtime dependency error and it will literally start reverse engineering things before even attempting to look at docs.
Re:AI is forcing us to pay off 40 years of technical debt by Loquebantur on Wednesday November 04, 2026 @09:37AM (#50366124)
The logical extrapolation of AI capabilities stress-testing human software is all bugs being discoverable. Hence, you have to aim for actually bug-free software.

The only way to do that is to make your code provable. That again is only realistically doable using AI.

In the process, people will have to turn the pretense of "software engineering" into reality, making the engineering part explicit.

That only works when humans actually understand what they're doing.

Re:AI is forcing us to pay off 40 years of technical debt by txdv on Wednesday November 04, 2026 @10:01AM (#50366510)
Engineering is the discipline of designing and implementing solutions that achieve desired outcomes, using limited resources, while satisfying a defined set of constraints and minimum acceptable standards.

We have way more resources now to achieve way higher standards.

Re:AI is forcing us to pay off 40 years of technical debt by Yokohiii on Wednesday November 04, 2026 @11:42AM (#50368167)
I don't think so. The article refers to formal verification, but also notes that proof checking should be done by humans. We don't have enough capable humans for that.
Re:AI is forcing us to pay off 40 years of technical debt by RHSeeger on Wednesday November 04, 2026 @12:13PM (#50368578)
As a general rule, building things as an engineering project (according to engineering, whatever you want to call it) doesn't prove they work. Rather, it proves they don't fail in specific known/defined ways. There's always ways they can fail that aren't known/checked, and frequently ways that aren't considered important.

Kind of like automated tests in software development. Except the people that pay for the engineering stuff are more likely to pay for the extra tests, because of liability.

Re:AI is forcing us to pay off 40 years of technical debt by dumah on Thursday November 05, 2026 @08:45AM (#50378984)
You’re twisting words here.

If a new jet completes extensive flight testing and has flown around the world but has undiscovered engineering flaws, “it’s working”.

Meeting verification and validation requirements in a sound engineering development program should certainly get you to “it’s working”, whether there are undiscovered engineering flaws or not.

Anything men build is subject to failure and unknown unknowns - so nothing works?

Re:AI is forcing us to pay off 40 years of technical debt by Den_VR on Wednesday November 04, 2026 @07:10PM (#50373241)
Engineering is the application of science and mathematics to solve problems and create solutions… that “application of science and mathematics” is what’s been missing from the majority these last 20 years.
Re:AI is forcing us to pay off 40 years of technical debt by Quimoniz on Wednesday November 04, 2026 @10:25AM (#50366924)
> "I have only proven [my code] correct, not bug free."

> -- Donald Knuth (if I recall that exact quote correctly)

Just because you have proven the correctness of your code, that does not mean that it is infallible. Especially -- as a lot of HN users point out -- there's intricate complexity that is likely to cause erroneous behavior if several interfaces/complexities get combined. And those might be caused, for example by a 'user' setting the driver to 'db.backend.sqlite' instead of 'db.backend.sqlite3'; and then you have suddenly an unexpected configuration.

Re:AI is forcing us to pay off 40 years of technical debt by Loquebantur on Wednesday November 04, 2026 @12:47PM (#50369034)
Yes, you can also easily prove the wrong thing.

That's why it doesn't suffice for only LLMs to know the relevant stuff.

You can't have a zoo run by animals.

Re:AI is forcing us to pay off 40 years of technical debt by Revanche1367 on Wednesday November 04, 2026 @01:34PM (#50369674)
Aren't all zoos technically run by animals? :D.
Re:AI is forcing us to pay off 40 years of technical debt by gfody on Wednesday November 04, 2026 @01:56PM (#50369965)
apt, as we try to contain the complexity of our designs while being ourselves panarchical hyper-systems
Re:AI is forcing us to pay off 40 years of technical debt by sach1 on Wednesday November 04, 2026 @02:01PM (#50370037)
Unrelated but "Panarchical Hypersystems" makes for a great company name
Re:AI is forcing us to pay off 40 years of technical debt by devonzh on Wednesday November 04, 2026 @03:13PM (#50370872)
Or a rock band. (With a nod to Dave Barry.)
Re:AI is forcing us to pay off 40 years of technical debt by 59percentmore on Thursday November 05, 2026 @12:48AM (#50375659)
Dovetails with a Daisuke Ishiwatari joint.
Re:AI is forcing us to pay off 40 years of technical debt by prcrstntr on Wednesday November 04, 2026 @02:02PM (#50370045)
Lower intelligence animals....oh wait
Re:AI is forcing us to pay off 40 years of technical debt by LeFantome on Wednesday November 04, 2026 @09:56PM (#50374561)
I once saw an interview with a guy that designed garbage cans for National Parks. When asked what the hardest part of the job was he said, “accounting for the considerable overlap between the dumbest humans and the smartest bears”.
Re:AI is forcing us to pay off 40 years of technical debt by hinkley on Wednesday November 04, 2026 @03:50PM (#50371309)
For months after some researchers “proved” our code signing system sound I was still finding security holes in the system. To this day I’m not sure what they proved. That the architecture worked? We’d already proven that to a hundred people.
Re:AI is forcing us to pay off 40 years of technical debt by socalgal2 on Thursday November 05, 2026 @03:06AM (#50376465)
Correct, because when there was no LLMs all code was perfect and bug free.
Re:AI is forcing us to pay off 40 years of technical debt by moomin on Wednesday November 04, 2026 @01:52PM (#50369904)
I mean, he wasn’t using, or even envisaging, a language that could natively support proofs.

Personally I think proving Kubernetes, for instance, would be an exercise in pure frustration. There’s just too much to do.

Re:AI is forcing us to pay off 40 years of technical debt by 27183 on Wednesday November 04, 2026 @01:54PM (#50369938)
Maybe that says something about kubernetes. Software systems that are complex enough to be intractable should probably be regarded as too complex to operate safely.
Re:AI is forcing us to pay off 40 years of technical debt by devin on Wednesday November 04, 2026 @02:16PM (#50370226)
Re:AI is forcing us to pay off 40 years of technical debt by 27183 on Wednesday November 04, 2026 @07:04PM (#50373175)
I don't fully understand what you're objecting to. Are you saying it's not possible to build a formally verified container orchestration thing?
Re:AI is forcing us to pay off 40 years of technical debt by hinkley on Wednesday November 04, 2026 @04:12PM (#50371590)
Knuth seemed more interested in Tony’s notion of “obviously no bugs”. There always seemed to me to be a self-evident flavor to his literate code notions.

I say that as someone who sees Knuth as problematic starting in the 2010’s. Physics governs so much of computational complexity now that I think the idealized form he presents has transitioned from merely holding us back to being crippling. Only game designers, hyperscalers, and an esoteric few of the rest of us seem to understand the vast gulf between theory and practice that has developed in the five orders of magnitude that compute power has experienced since his first edition.

Many, many things that are considered constant in his world are instead logarithmic to the size of the data being managed, or in the case of very large data sets, order n^1/2 because of speed of light and thermodynamics. That vastly reorders the toolbox, because second shelf algorithms now rival or beat the top shelf ones and some options even farther down now become interesting for novel situations.

Re:AI is forcing us to pay off 40 years of technical debt by Quimoniz on Wednesday November 04, 2026 @07:22PM (#50373337)
huh. Interesting background. Thanks for sharing.

Regarding your remark "[...] because second shelf algorithms now rival or beat the top shelf ones [...]". That is honestly something I would never have believed back in the 2000s, Windows XP era:

I thought we needed more than the classic mathematical operations and if/else for an operating system that drives the modern world like it had been envisioned by sci-fi in the past 100 years.

That turned out to be wrong: Your modern android with a couple of simple apps is everything a man from 1900 might ever conceivably want from technology.

And it is all if/else/while and mathematical operations.

It turned out you just needed enough of these, to get everything working nicely.

Watching in awe. Watching in awe.

Re:AI is forcing us to pay off 40 years of technical debt by svachalek on Wednesday November 04, 2026 @02:21PM (#50370285)
This doesn't necessarily require proving everything mathematically, it also helps to design things in a way that doesn't rely on discipline to avoid gaping holes. For example, languages that allow pointer arithmetic, unchecked array access, or use-after-free have huge opportunities to make security errors that don't exist in languages without them.
Re:AI is forcing us to pay off 40 years of technical debt by skydhash on Wednesday November 04, 2026 @03:23PM (#50370983)
> For example, languages that allow pointer arithmetic, unchecked array access, or use-after-free have huge opportunities to make security errors

All languages are built on top of an ISA, whether directly (assembler), or by mapping it to an abstract machine. The you have the dreaded “eval” function. Then because a lot of software lives on top of an OS, there’s all the virtualization that is going on (timesharing, virtual memory, filesystems,…). Memory safety is nice, but it doesn’t help you when the attacker send valid, but malicious data from a compromised source, or by exploiting a logic error.

And for kernel code, where everything is accessible to everyone, it’s much a matter of discipline, especially with so much hardware interrupts and syscalls from userspace going around. Most kernel code has very short lifecycle, it’s the data that is long lived, and it’s a shapeless blob in memory that you have to trust the other party kept in good shape.

Re:AI is forcing us to pay off 40 years of technical debt by hinkley on Wednesday November 04, 2026 @03:56PM (#50371391)
A problem I frequently have with setting up testing policies is in convincing people to test what they can reliably test with the tools, and know what they cannot test.

Inconclusive tests to increase automation and coverage accomplish less than nothing. The opportunity cost, the loss of trust, the conflation of the manual testing surface area, are all worse than doing nothing.

The point of testing is to establish a level of trust. That level doesn’t need to be 100%. It can’t be 100% regardless. So you do what you can, and you solve the remaining problem a different way. But you need to know it’s there to address it, and the smoke and mirrors fight that.

Re:AI is forcing us to pay off 40 years of technical debt by annzabelle on Wednesday November 04, 2026 @09:49PM (#50374495)
I used to work for a company that enforced 80% code coverage for our CI/CD pipelines. Both teams I worked with there, in wildly different parts of the company, were playing games with excluding most files in the repo and writing dozens of tests that didn't actually test anything, just ran the code in the testing container so the lines would count as having been tested. I think LLMs have probably cleaned it all up a lot in the end, because the tests they write do actually test the code (against the code at the point you told the LLM to write the test a lot of the time, rather than a third party spec, but at least it's not just return true all the time).

Every 6 months there was a new testing initiative, which seemed to all be responded to by writing wrappers that returned true to the test automation system we were ordered to use.

Re:AI is forcing us to pay off 40 years of technical debt by latentsea on Thursday November 05, 2026 @04:59AM (#50377316)
Seems like a culture problem at both ends of the org.
Re:AI is forcing us to pay off 40 years of technical debt by hinkley on Thursday November 05, 2026 @02:17PM (#50383175)
It’s a pretty common failure mode in my experience. Keep management out of testing as long as you can.
Re:AI is forcing us to pay off 40 years of technical debt by latentsea on Thursday November 05, 2026 @09:14PM (#50387288)
Keep shitty tests out. PRs with vacuous tests should be rejected. You can have high coverage and good tests. These aren't mutually exclusive.
Re:AI is forcing us to pay off 40 years of technical debt by hinkley on Thursday November 05, 2026 @02:16PM (#50383165)
I’ve seen that behavior but it usually doesn’t kick in until the mandate 90%, so that’s a shame. Usually I push back on it being a rule because if you have low coverage, you have a team that’s not good at automated testing, and forcing them to write a lot of tests before they’ve gotten good at it always ends poorly. But typically nobody listens and the shitshow begins.
Re:AI is forcing us to pay off 40 years of technical debt by gopher_space on Friday November 06, 2026 @06:33PM (#50399957)
Demonstrate the good vs bad test cases to people by doing an obviation pass over your test suite. Lots of things to look for, like misunderstanding the flow of data authority or testing against things that are fundamentally Somebody Else's Problem.

A base exercise in this vein would be asking someone to describe how a failure state they're checking for could come to exist in your current system.

Re:AI is forcing us to pay off 40 years of technical debt by eru on Thursday November 05, 2026 @03:09AM (#50376489)
Using these languages is pretty close to a mathematical proof.
Re:AI is forcing us to pay off 40 years of technical debt by MisterMunchkin on Wednesday November 04, 2026 @03:11PM (#50370847)
If the user is capable of setting an option which breaks everything then your code isn’t correct.

That’s the whole point, you can find all of these things which would take far too much manual effort.

Re:AI is forcing us to pay off 40 years of technical debt by timschmidt on Wednesday November 04, 2026 @03:21PM (#50370956)
The user may be capable of undervolting the logic, issuing directed EM attacks, accessing JTAG, etc. Good luck.
Re:AI is forcing us to pay off 40 years of technical debt by solyin on Wednesday November 04, 2026 @04:48PM (#50372025)
The user doesn't have to be someone that grew up on Defcon talks and CTFs anymore though. Any Joe/Jane off the street can ask an LLM what is a JTAG or what is a 90 nop and keep asking until they're satisfied. So we have to assume the user is capable of all of those things.
Re:AI is forcing us to pay off 40 years of technical debt by wizzwizz4 on Thursday November 05, 2026 @02:46PM (#50383521)
We used to have these things called "books" that you could ask. (And if you didn't know which book to consult, we had these people called "librarians".) I don't think it's a much greater threat surface than before: if anything, it might be smaller, because the internet is harder to search.
Re:AI is forcing us to pay off 40 years of technical debt by timschmidt on Thursday November 05, 2026 @09:50PM (#50387553)
As someone who grew up with libraries, card catalogs, microfiche, and an encyclopedia, I can confidently say that talking to and working with an LLM is much faster, much easier, and much more informative than all of the above combined.
Re:AI is forcing us to pay off 40 years of technical debt by telebub on Wednesday November 04, 2026 @03:28PM (#50371055)
Here the user was the deployer and presumably owner of the deployment. An overall setup is only correct if they and the software define a setup that happens to be correct. The software is incorrect if it doesn't support the incorrect setup they require.
Re:AI is forcing us to pay off 40 years of technical debt by hinkley on Wednesday November 04, 2026 @03:51PM (#50371334)
> The software is incorrect if it doesn't support the incorrect setup they require.

Is that what you intended to type?

Software is not required to support the requirements of every potential user. Only the ones they mean to support. That’s why Porsche and BMW ignore people complaining about how expensive they are. You aren’t their customer and they don’t want you.

Re:AI is forcing us to pay off 40 years of technical debt by telebub on Wednesday November 04, 2026 @04:35PM (#50371891)
A family of eight who buys a (classic) Porsche bought an incorrect car unless it is for an expensive gag like putting sugar in the gas tank then an EV would be incorrect, no?
Re:AI is forcing us to pay off 40 years of technical debt by hinkley on Wednesday November 04, 2026 @07:03PM (#50373165)
As written you have stated that Porsche is wrong for ignoring this family's complaints. Because they didn't support an unsupported configuration.
Re:AI is forcing us to pay off 40 years of technical debt by telebub on Thursday November 05, 2026 @01:45AM (#50375954)
You are confusing the wants of a manufacturer with a system that is being used by a person. The person owns the system that is either correct or incorrect for their needs and the manufacturer takes money and screws off. Or, you have the "soup Nazi" as proposed with the manufacturer makes sure you use the system as they imagined and not with a database setup beyond their control.
Re:AI is forcing us to pay off 40 years of technical debt by wolrah on Wednesday November 04, 2026 @10:31PM (#50374793)
The zero, one, infinity rule isn't directly relevant here but it's close enough to be worth mentioning IMO.

https://en.wikipedia.org/wiki/Zero-one-infinity_rule

The rule is about data structures but I feel it has wider applicability user choices in software. You should either give the user no choices, give them individual binary choices, or let them pick anything that could theoretically be valid and design your system to assume they'll sometimes pick invalid options which will need to be handled appropriately.

Re:AI is forcing us to pay off 40 years of technical debt by hinkley on Wednesday November 04, 2026 @03:47PM (#50371277)
Just because it works doesn’t mean it’s not broken.

Anyone who has ever wielded a wrench should know that implicitly.

Re:AI is forcing us to pay off 40 years of technical debt by jopsen on Wednesday November 04, 2026 @05:59PM (#50372644)
Play a bit with it, I started feeling like verification is just a slightly more aggressive fuzzer.

There will also be compiler bugs, etc.

The point is fewer bugs.

Re:AI is forcing us to pay off 40 years of technical debt by kolinko on Thursday November 05, 2026 @03:54AM (#50376840)
At least in some cases it is easier to verify bytecode/assembly than source code.
Re:AI is forcing us to pay off 40 years of technical debt by casey2 on Wednesday November 04, 2026 @08:38PM (#50373964)
Which implies that software engineers in the future won't be so cavalier in allowing mod-able or unix-like systems. There won't be an db.backend.sqlite since your software likely won't use a db, and if it does it will be a custom design. It won't be "if several interfaces" it will be "there are no interfaces" no programmer interfaces and certainly no user ones.
Re:AI is forcing us to pay off 40 years of technical debt by phorkyas82 on Thursday November 05, 2026 @02:53AM (#50376368)
Were you aiming for this? “Program testing can be used to show the presence of bugs, but never to show their absence!” ― Edsger W. Dijkstra

Or the second one, that I would have attributed to Dijkstra, too: “There are two ways of constructing a software design: One way is to make it so simple that there are obviously no deficiencies and the other way is to make it so complicated that there are no obvious deficiencies.” C.A.R. Hoare, The 1980 ACM Turing Award Lecture

Re:AI is forcing us to pay off 40 years of technical debt by raphlinus on Thursday November 05, 2026 @03:32AM (#50376659)
No, it's Knuth. The exact quote is "Beware of bugs in the above code; I have only proved it correct, not tried it." [1]

[1]: https://staff.fnwi.uva.nl/p.vanemdeboas/knuthnote.pdf

Re:AI is forcing us to pay off 40 years of technical debt by eru on Thursday November 05, 2026 @03:08AM (#50376482)
> Just because you have proven the correctness of your code, that does not mean that it is infallible.

Yes, but it gets you pretty far already.

Re:AI is forcing us to pay off 40 years of technical debt by ourmandave on Thursday November 05, 2026 @06:42AM (#50377987)
Just because you have proven the correctness of your code, that does not mean that it is infallible.

Can god make a zero-day even he can't find?

Re:AI is forcing us to pay off 40 years of technical debt by ElectricalUnion on Thursday November 05, 2026 @06:51AM (#50378060)
Most bad crypto code in the world is unbreakable by it's creator.
Re:AI is forcing us to pay off 40 years of technical debt by zeroonetwothree on Wednesday November 04, 2026 @11:32AM (#50368013)
Just like we make bridges and buildings “provable”?
Re:AI is forcing us to pay off 40 years of technical debt by dataflow on Wednesday November 04, 2026 @12:07PM (#50368506)
[delayed]
Re:AI is forcing us to pay off 40 years of technical debt by WalterBright on Wednesday November 04, 2026 @12:40PM (#50368928)
Buildings and bridges have very large safety margins, to account for design errors, construction errors, damage, poor materials, etc.

Airplanes have much smaller safety margins, meaning a lot more calculation is done, and there's a high emphasis on double checking everything.

Spacecraft have tiny safety margins, which amps up the design rigor to 11.

Re:AI is forcing us to pay off 40 years of technical debt by R0m41nJosh on Thursday November 05, 2026 @01:20AM (#50375837)
Airplanes and srarcrafts are operated by a trained trusted crew. Software is operated continuously by lots of hostile people and machines.

When terrorists take the control of a plane, it's a catastrophe.

Re:AI is forcing us to pay off 40 years of technical debt by jameshart on Wednesday November 04, 2026 @01:12PM (#50369376)
On the contrary - this is explicitly the mission of most military organizations. There are countries in the world today where every day their bridges and buildings face adversarial attacks from state level threat actors.

The difference is, people who build civilian bridges and buildings are not actually generally expected to build structures that can withstand such attacks because preventing those attacks is considered the government’s job.

So no, they typically don’t undergo ‘more rigorous testing’ than software against security threats. The fact that governments make no effort to protect networked systems from being attacked places the burden of withstanding those attacks fully on the private civilian operators.

Re:AI is forcing us to pay off 40 years of technical debt by pegasus on Wednesday November 04, 2026 @03:02PM (#50370746)
In an important way bridges and buildings are indeed proven to be sound by applying the mathematical tools of structural engineering, materials science, etc. Software Engineering also has analogous formal tools at its disposal (Lean is one gaining a lot of exposure these days), but many were being neglected because it wasn't worth the bother. In this new adversarial world, we'll be forced to reach for them more often. Luckily the models are also a big help in making these tools more approachable.
Re:AI is forcing us to pay off 40 years of technical debt by dbingham on Wednesday November 04, 2026 @11:40AM (#50368136)
While I whole-heartedly support the goal of actually bug free software and treating software engineering as a serious engineering discipline, as an experienced software engineer who also studied physics, I have to challenge your base premise about what it means to make engineering explicit.

Namely:

> The only way to do that is to make your code provable.

Proofs are a mathematical concept. They only work in the abstract world of mathematics where everything is perfectly logical.

Engineering exists in the real world. The physical realm where our mathematics are only imperfect models of what actually exists. Removing bugs through physical engineering requires persistent trial and error until you have found all the places where our mathematical models don't adequately represent the real world.

It's the same in software engineering, which involves cobbling together a myriad of systems not all designed to talk to each other and massive, ever changing codebases where perfect knowledge is impossible.

So yes, we should be trying to engineer bug free code. But that's really more a matter of changing our resource allocation, spending more time and money on QA and doing away with mottos like "Move fast and break things". It's a cultural shift and will only come when the bosses -- the venture capitalists who ultimately control our industry -- are held accountable when things break, and given strong incentives to ensure they don't break.

Re:AI is forcing us to pay off 40 years of technical debt by bathtub365 on Wednesday November 04, 2026 @11:44AM (#50368203)
[delayed]
Re:AI is forcing us to pay off 40 years of technical debt by joshheitzman on Wednesday November 04, 2026 @11:56AM (#50368369)
A PE for software engineering was available for a while: https://ncees.org/ncees-discontinuing-pe-software-engineerin...

But there wasn't enough demand and it was discontinued.

Re:AI is forcing us to pay off 40 years of technical debt by gmueckl on Wednesday November 04, 2026 @12:23PM (#50368689)
The legal framework for software liability is tightening. The Cyber Resilience Act is one such example that forces developers to get their act together.
Re:AI is forcing us to pay off 40 years of technical debt by WalterBright on Wednesday November 04, 2026 @12:36PM (#50368872)
Back when I worked at Boeing, I was encouraged to get a PE license. I looked into it. I was not impressed with the exam (it was too basic), nor the requirements, and so did not bother.
Re:AI is forcing us to pay off 40 years of technical debt by IAmBroom on Wednesday November 04, 2026 @02:03PM (#50370056)
This is a zero-value post.

"I decided for myself that X wasn't worth me pursuing as a path for my career." Good for you.

I made the same decision for professional photography and cardiac surgery, but both of those careers still hold value to society.

Re:AI is forcing us to pay off 40 years of technical debt by WalterBright on Wednesday November 04, 2026 @03:39PM (#50371177)
The point was that the PE cert is a low bar as an indication of competence.
Re:AI is forcing us to pay off 40 years of technical debt by AnthonyMouse on Wednesday November 04, 2026 @01:45PM (#50369826)
> It's a cultural shift and will only come when the bosses -- the venture capitalists who ultimately control our industry -- are held accountable when things break, and given strong incentives to ensure they don't break.

The problem here is that the correct amount of resources is context-dependent.

Suppose you're a small business and you're putting up a website to display the menu for your restaurant and directions to get there. Do you want it to get compromised? Of course not. Does it matter very much if it does? Eh. Should you spend $50M in formal verification to make sure it doesn't? Definitely not.

Whereas if you're developing the software that keeps planes from falling out of the sky, that's an entirely different context.

The problem comes when someone grabs the awful WordPress junk that was suitable for displaying static menus and wants to use it to process credit cards. But even that isn't really the fault of the awful WordPress junk, it's the fault of the credit card companies for designing their financial technology in such a ridiculous way that Merchant A has to be given a secret that allow purchases to be made against the same card at Merchant B, instead of using the decades-old cryptography that would prevent the customer from ever needing to give anyone a secret that enables that wide a scope of compromise.

Re:AI is forcing us to pay off 40 years of technical debt by Loquebantur on Wednesday November 04, 2026 @01:45PM (#50369827)
The physical world is actually part of mathematics. Look into John Archibald Wheeler and his "It from bit". In particular, the physical world is finite. Therefore, mathematical proofs very much apply to physics.

You're right about approximations: we gather data and improve theoretical models in an attempt to exhaust that complexity reality poses.

You're wrong about exhaustive knowledge about codebases being impossible. LLMs enable exactly that.

The trick then is to transfer that knowledge in a usable way to what we know about the codebase.

I agree with the necessary cultural shift.

Re:AI is forcing us to pay off 40 years of technical debt by saalweachter on Wednesday November 04, 2026 @02:02PM (#50370042)
Keep in mind, a mathematical proof is just "an argument that convinces a mathematician".

It doesn't actually give you the truth of a statement, it just convinces a mathematician of its truth.

That doesn't actually change when computers are brought into things. You can convince a mathematician that an automatic theorem prover constructs correct proofs with another proof, but it's "I think this looks right" all the way down.

Re:AI is forcing us to pay off 40 years of technical debt by Loquebantur on Wednesday November 04, 2026 @03:47PM (#50371273)
No, you're incorrect. A mathematical proof actually is a program by the Curry-Howard correspondence.

Mathematicians are trained to act as the compiler, verifying the code, doing the type checks, and to a degree the state machine "running" those programs.

Human mathematicians use introspection to tell you whether a proof/program does what it is supposed to do. They keep those programs small enough to be run on human brains by modularization, abstracting away complexity behind defined interfaces. They mostly rely on other mathematicians to have checked those sub-modules properly.

By defining that state machine, compiler and the tree of "all" known proofs as programs explicitly on a computer, you get Lean and the according libraries of verified proofs.

A proof-program there is verified when it compiles and passes the deterministic structural type-checks built into the language while fulfilling the requirements stated for its interface.

It all reduces to a few thousand lines of trusted code, the Lean kernel, being correct. It's mostly what humans do too, but actually considerably more thorough.

Re:AI is forcing us to pay off 40 years of technical debt by lilbigdoot on Wednesday November 04, 2026 @11:44AM (#50368196)
> The only way to do that is to make your code provable. That again is only realistically doable using AI.

I think that LLMs actually cannot do this right now while people can?

Also there is a lot of defensive programming that has been left to application and runtime layers because of dated security models in our OS and permissions that are way too coarse. It's a lot easier to write a correct program when you don't have to check every path and do that perfectly when the permission system can ensure that no files that haven't been whitelisted cannot be read

Re:AI is forcing us to pay off 40 years of technical debt by criley2 on Wednesday November 04, 2026 @11:55AM (#50368361)
https://bend-lang.com/

Folks are creating some interesting stuff in this space

Re:AI is forcing us to pay off 40 years of technical debt by Loquebantur on Wednesday November 04, 2026 @12:44PM (#50368993)
LLMs can, in principle, do everything humans can. And arguably more. "Right now" is how long? People are slow.

"Provable" essentially means, you have explicit operators acting on explicit states in an exhaustively defined way that preserves "truth", explicitly defined invariants.

A finite thing you can argue over deterministically.

Obviously, "you" there is an LLM, the machine your code is run on has to be defined in that very same exacting manner and so on.

That still isn't enough, you need abstraction, a hierarchy of categories that preserve your intent and accurately describe the problem space.

"Programming" then is solving an inverse problem over that hierarchy, filling in the blanks sensibly on your way down through the model hierarchy, all the way to atomic instructions your (proven) hardware understands.

Those layers of proper abstraction is what's largely missing currently. Or rather, is merely vaguely approximated.

All of which is to say: yes, the current state is a mess. Resolving that is far from easy.

But you really have no choice, that mess is transparent to large-enough LLMs. Security by obscurity only goes so far.

Re:AI is forcing us to pay off 40 years of technical debt by boston_clone on Wednesday November 04, 2026 @01:05PM (#50369272)
> LLMs can, in principle, do everything humans can.

I think narrowing the scope of this statement would better support your argument, as it is easily disproved in its current form.

Re:AI is forcing us to pay off 40 years of technical debt by AnthonyMouse on Wednesday November 04, 2026 @01:21PM (#50369486)
> But you really have no choice, that mess is transparent to large-enough LLMs.

It's transparent to large-enough LLMs given enough resources. Which is the thing that was always true. The difference now is that the level of resources is lower, so we're finding a bunch of things it wasn't previously economical to find.

But the cost still isn't zero. On top of that, the same LLMs are now generating enormous volumes of new code, which both nobody has verified to that level of exaction and nobody has even considered how it interacts with existing and other new code.

Re:AI is forcing us to pay off 40 years of technical debt by lilbigdoot on Wednesday November 04, 2026 @01:33PM (#50369656)
> Those layers of proper abstraction is what's largely missing currently. Or rather, is merely vaguely approximated.

This I can agree with, and my perspective would be that we have theoretical solutions with no ergonomics, and rely on unproven (as in formally proven/validated) mechanisms. WASM + capability passing is enough, but the WASM layer is still built on an OS or runtime that is not proven and you'll have a heck of a time trying to build a product on it

Re:AI is forcing us to pay off 40 years of technical debt by freecodeio on Wednesday November 04, 2026 @01:39PM (#50369737)
LLMs can't do a backflip. I can.
Re:AI is forcing us to pay off 40 years of technical debt by drivebyhooting on Wednesday November 04, 2026 @02:22PM (#50370296)
I can’t do a backflip. I guess I’m subservient to LLMs then.
Re:AI is forcing us to pay off 40 years of technical debt by solyin on Wednesday November 04, 2026 @04:50PM (#50372052)
Unitree's H2-X can.

https://youtu.be/Y3zb4o47yqA

Re:AI is forcing us to pay off 40 years of technical debt by deadfoxygrandpa on Wednesday November 04, 2026 @08:59PM (#50374136)
is unitree h2-x an llm?
Re:AI is forcing us to pay off 40 years of technical debt by braj0 on Thursday November 05, 2026 @03:05PM (#50383759)
why not? I'm sure you could bolt one onto it...
Re:AI is forcing us to pay off 40 years of technical debt by combinebeatsai on Wednesday November 04, 2026 @08:30PM (#50373892)
> LLMs can, in principle, do everything humans can.

Oh yeah? slides baton Pick up that can, Clanker.

Jokes aside, I do want to see the first news of AI going out of its way to acquire and make use of actual currency and hiring a meat proxy. I don't even care what for, can be making paperclips.

Re:AI is forcing us to pay off 40 years of technical debt by khafra on Thursday November 05, 2026 @06:36AM (#50377948)
The first such news is pretty old: In ARC's 2023 eval of GPT-4, it hired a TaskRabbit worker to bypass a CAPTCHA out of the small research budget allocated to the agent.
Re:AI is forcing us to pay off 40 years of technical debt by xanderbookface on Thursday November 05, 2026 @08:48PM (#50387129)
What do you think would b e a good experiment to run? At this point it could be interesting to just give AI some money, connect it to rentahuman, and see what it does.
Re:AI is forcing us to pay off 40 years of technical debt by adastra22 on Wednesday November 04, 2026 @01:42PM (#50369773)
My intuition is the opposite? The math results we are seeing lately are done with theorem provers. LLMs are getting very good at this and surpassing what humans have been able to prove. Verified code is traditionally very expensive and only applicable in niche areas when done by humans.
Re:AI is forcing us to pay off 40 years of technical debt by foopod on Wednesday November 04, 2026 @02:23PM (#50370318)
> LLMs are getting very good at this and surpassing what humans have been able to prove.

But if the reverse were true it would be impossible to prove. AI is trained on all of humanities solutions - LLMs stand on the shoulders of giants, not the other way around.

Re:AI is forcing us to pay off 40 years of technical debt by gfosco on Wednesday November 04, 2026 @02:32PM (#50370422)
We do, too, as we have also been trained from the same prior solutions.
Re:AI is forcing us to pay off 40 years of technical debt by adastra22 on Wednesday November 04, 2026 @05:48PM (#50372560)
As of today, the training data the originates from humans represents a vanishingly small portion of the total training. The vast majority of training - how many 9’s is a trade secret - of a frontier model is synthetic RLVR data. That’s how they got good at this.
Re:AI is forcing us to pay off 40 years of technical debt by drdeca on Thursday November 05, 2026 @12:14AM (#50375481)
[delayed]
Re:AI is forcing us to pay off 40 years of technical debt by adastra22 on Thursday November 05, 2026 @10:47AM (#50380576)
It’s an increasing portion of training month by month. As of this last summer, pretty much all new GPU hardware is going to a combination of inference and post-training model tuning, generally RLVR.
Re:AI is forcing us to pay off 40 years of technical debt by doug_durham on Wednesday November 04, 2026 @12:07PM (#50368511)
No software of normal complexity can be "provable". There will always be bugs no matter the strength of the AI.
Re:AI is forcing us to pay off 40 years of technical debt by theendisney on Wednesday November 04, 2026 @10:49PM (#50374925)
Normal in some cases might be far from what was really needed. Perhaps the two kinds of software can grow further appart?
Re:AI is forcing us to pay off 40 years of technical debt by alerighi on Wednesday November 04, 2026 @12:12PM (#50368556)
> That again is only realistically doable using AI

The opposite. The amount of bugs that I've seen AI add to software is tremendous, some bugs are things that even a 18 years old that starts working as a developer right after school wouldn't do.

Also they are unable to fix them, if you ask them to fix a bug they probably introduce 3 other more, and so on, and you arrive quickly at the point that the code is a mess of spaghetti that needs to be rewritten completely (by a human, this time).

On the opposite side AI is good at finding bugs, so I use it more as an advanced linter that tells me if I'm doing something wrong.

Re:AI is forcing us to pay off 40 years of technical debt by dpark on Wednesday November 04, 2026 @12:16PM (#50368603)
You’re describing vibe coding and GP is describing systems for proving correctness.

If you ask an AI to generate a novel math proof, it will inevitably produce garbage. If you give it the tools to do this (e.g. Lean), evidence is that it can in fact generate meaningful proofs.

To the extent that we cannot prove software correct, this is probably largely a tooling problem.

Re:AI is forcing us to pay off 40 years of technical debt by icantevenhold on Wednesday November 04, 2026 @01:33PM (#50369659)
“tooling problem” makes it sound trivial, its a tooling problem like building a quantum computer is a tooling problem. Ie something that probably won’t be solved in our lifetime
Re:AI is forcing us to pay off 40 years of technical debt by dpark on Wednesday November 04, 2026 @01:57PM (#50369987)
> something that probably won’t be solved in our lifetime

If you told me five years ago that AI would eventually be generating novel math proofs, I probably would’ve said that it’s not happening in my lifetime. And yet here we are.

I don’t know what it looks like to get to fully provable code, but I don’t see that it’s fundamentally impossible in my lifetime. Especially depending on scope. Will an entire operating system and everything on it be fully proven correct in my lifetime? Maybe not. Could the authentication stack for a product be entirely proven correct? Sure. I can’t believe that.

Re:AI is forcing us to pay off 40 years of technical debt by skydhash on Wednesday November 04, 2026 @03:38PM (#50371172)
> If you told me five years ago that AI would eventually be generating novel math proofs, I probably would’ve said that it’s not happening in my lifetime. And yet here we are.

A single PC can solve a very complex simulation model in seconds, something that would require years using humans to do. Same as solving a very complicated maze. So if coupling a text generator with a proof verifier is now capable of coming up with a proof, I’m not particularly surprised. But given the cost, and the actual usefulness of the proof, I’m not particularly excited either.

But code is not a closed system, even if we do prove a lot of the internal mechanism, we still can’t know the input (noise), and whether the axiomatic foundation will hold. That’s the reason people don’t bother. The theory of computation is just too loose in its constraints. You just write enough tests to catch egregious errors.

Re:AI is forcing us to pay off 40 years of technical debt by velox_neb on Wednesday November 04, 2026 @05:18PM (#50372295)
> we still can’t know the input (noise)

Doesn't matter. Just like you can prove something is true for all numbers, you can prove something is true for all possible inputs.

Re:AI is forcing us to pay off 40 years of technical debt by LordDragonfang on Wednesday November 04, 2026 @05:19PM (#50372301)
> But code is not a closed system

Code is absolutely a closed system.

"Software" might not be, and definitely not software systems -- but code can have each part of it atomically proven to be correct, assuming you test it with a sufficiently complex simulation model (which you've already granted is within the possibilities for LLMs).

Prove all the code in the software system correct, then prove their interactions are correct, and you've achieved your goal.

(I won't claim this is inevitable with the current tools, but it's at least within the realm of possibility)

Re:AI is forcing us to pay off 40 years of technical debt by kulahan on Wednesday November 04, 2026 @03:08PM (#50370818)
You should try AI out, it’s a lot more capable than it was when most people formed their opinion a few years ago.
Re:AI is forcing us to pay off 40 years of technical debt by icantevenhold on Friday November 06, 2026 @05:56AM (#50390786)
I use it every day
Re:AI is forcing us to pay off 40 years of technical debt by LordDragonfang on Wednesday November 04, 2026 @12:17PM (#50368616)
What model are you talking about when you say this? "AI" is not one thing, and if you think frontier models are at all comparable to a typical 18yo SWE, you've never actually worked with one of those two.
Re:AI is forcing us to pay off 40 years of technical debt by 10111001 on Wednesday November 04, 2026 @12:14PM (#50368581)
> The logical extrapolation of AI capabilities stress-testing human software is all bugs being discoverable. Hence, you have to aim for actually bug-free software.

> The only way to do that is to make your code provable. That again is only realistically doable using AI.

If you're code is "provable" doesn't that only mean you've proved the code meets its specification? The specification can still have bugs.

Re:AI is forcing us to pay off 40 years of technical debt by Loquebantur on Wednesday November 04, 2026 @01:34PM (#50369668)
Yes, that's where the "engineering" part comes in.

Engineering builds models that approximate the real world under practical considerations. You e.g. have to weigh costs vs risks and apply good judgement.

In essence, you try to achieve the best possible with the resources you've got.

Re:AI is forcing us to pay off 40 years of technical debt by IAmBroom on Wednesday November 04, 2026 @02:10PM (#50370144)
You are describing the difference between Verification (Does this do what we explicitly said it would do?) and Validation (Does this do what we wanted to achieve?). One is about compliance of design promises, and the other covers the issue that the various levels of design documents might have failed to completely capture intent.
Re:AI is forcing us to pay off 40 years of technical debt by ryandrake on Wednesday November 04, 2026 @12:24PM (#50368696)
Looks like AI is finally proving Linus's Law[1]: "given enough eyeballs, all bugs are shallow"

Open Source was supposed to prove this, but as it turns out, there weren't enough human eyeballs, and those eyeballs weren't looking for bugs. LLMs eyeballs see the entire codebase at once.

1: https://en.wikipedia.org/wiki/Linus%27s_law

Re:AI is forcing us to pay off 40 years of technical debt by drivebyhooting on Wednesday November 04, 2026 @02:25PM (#50370330)
The corollary is that given shallow enough eyes, all bugs are deep.
Re:AI is forcing us to pay off 40 years of technical debt by kulahan on Wednesday November 04, 2026 @03:04PM (#50370777)
A mostly useless platitude since the solution is to simply not include only terrible reviewers as 100% of your staff in 100% of situations.
Re:AI is forcing us to pay off 40 years of technical debt by avadodin on Thursday November 05, 2026 @03:43AM (#50376755)
make no mistakes
Re:AI is forcing us to pay off 40 years of technical debt by adrianN on Wednesday November 04, 2026 @01:24PM (#50369522)
Most bugs are not security issues and most potential security issues aren’t exploitable. So you can have plenty of bugs in your code without getting hacked.
Re:AI is forcing us to pay off 40 years of technical debt by Betelbuddy on Wednesday November 04, 2026 @03:15PM (#50370887)
>> The only way to do that is to make your code provable.

Extreme naivety alarm... Explain how code provable allows for bug free software. Would love to understand the intellectual jump there.

Re:AI is forcing us to pay off 40 years of technical debt by btilly on Wednesday November 04, 2026 @03:26PM (#50371025)
The quote was, "Beware of bugs in the above code; I have only proved it correct, not tried it."

The quote captured the fact that a human reviewed proof could have mistakes in it. This is very different from a Lean verified proof.

Re:AI is forcing us to pay off 40 years of technical debt by c_engineer56 on Wednesday November 04, 2026 @04:42PM (#50371966)
How do you prove the correctness of your theorem prover?
Re:AI is forcing us to pay off 40 years of technical debt by drdeca on Thursday November 05, 2026 @12:20AM (#50375513)
Depends which way you mean. It is possible to provide a formal specification for a proof verification engine and prove, in the same language that the engine is for, that the engine implements that specification.

Proving that the system it implements is like, logically sound, is a different issue, and for that you do need stronger axioms.

Re:AI is forcing us to pay off 40 years of technical debt by jwpapi on Wednesday November 04, 2026 @06:19PM (#50372805)
Software could be bug-free without being proven?
Re:AI is forcing us to pay off 40 years of technical debt by PeterStuer on Thursday November 05, 2026 @03:40AM (#50376729)
If mathematics serves as a example, the tools were there, but so tedious and unenjoyable to use it took AI to actually make their usage a reality.

Clanker doesn't care it's boring or too much work. Clanker just grinds 24/7.

Re:AI is forcing us to pay off 40 years of technical debt by aborsy on Wednesday November 04, 2026 @12:00PM (#50368428)
It would be the opposite. While old backdoors will be patched (if not switched off already), new ones will be added with AI that only few states will have.
Re:AI is forcing us to pay off 40 years of technical debt by phendrenad2 on Wednesday November 04, 2026 @12:06PM (#50368504)
[delayed]
Re:AI is forcing us to pay off 40 years of technical debt by vulk on Wednesday November 04, 2026 @12:32PM (#50368820)
We will leave with more robust software if there are people understanding how this software can be build. Don't forget that the industry as whole stopped hiring new people who wants to enter this field, also skill degradation is a real thing.
Re:AI is forcing us to pay off 40 years of technical debt by lelanthran on Wednesday November 04, 2026 @02:40PM (#50370497)
> It’s frustrating to have all these 0days and CVEs to patch for now, but in the long run perhaps we’ll leave with more robust software.

I'm skeptical; every line of code is a liability. Humans regularly make the trade-off between adding lines of code vs doing without the incremental feature addition. LLMs don't; everything gets added.

The recent brotli attack should have been a wakeup call - few people use it, no one actually needs it, but the exploit that it carried was present on every system. Everything from IIS to Caddy and in-between, and yet no one was actually using the thing.

It's a liability to add code, whether you're duplicating existing code in the codebase or adding a feature 1% will use.

Re:AI is forcing us to pay off 40 years of technical debt by jsbg on Wednesday November 04, 2026 @02:59PM (#50370715)
> LLMs don't; everything gets added.

By default, yes. But you don't have to let them, and enforcing some code quality was shown to use significantly fewer tokens (can't find the link now).

Re:AI is forcing us to pay off 40 years of technical debt by deepsun on Wednesday November 04, 2026 @03:01PM (#50370726)
I was really surprised that "sudo" command depends on "protobuf": https://ubuntu.com/security/notices/USN-5811-1
Re:AI is forcing us to pay off 40 years of technical debt by MetaWhirledPeas on Wednesday November 04, 2026 @03:03PM (#50370755)
> LLMs don't; everything gets added.

LLMs can run with whatever directive you give them. If the directive is lots of code that's what you get. But when everyone gets repeatedly burned by vulnerabilities the directive becomes building bullet-proof code. With the right prompting an LLM can be a lot more diligent about that than we ever could.

Re:AI is forcing us to pay off 40 years of technical debt by Brian_K_White on Wednesday November 04, 2026 @03:13PM (#50370870)
This is like saying humans just shouldn't gamble or drink or have sex with the wrong people.

It might be true but it's also a pointless statement that doesn't impact the problem, because it won't happen. And "it won't happen" isn't some unsupported prediction that no one can say. The aggregate behaviour of humans is a known thing, and it's not productive to the actual problem to pretend otherwise. It's only productive an individual looking for an easy excuse to avoid dealing with the problem.

Re:AI is forcing us to pay off 40 years of technical debt by tensor on Wednesday November 04, 2026 @10:42PM (#50374868)
Uh, I'm literally asking LLMs to shorten code daily. Sure not everyone will but I think the point is that LLMs likely do make it possible to write far more robust and secure software, including short code, if the user wants to.
Re:AI is forcing us to pay off 40 years of technical debt by saidnooneever on Wednesday November 04, 2026 @03:21PM (#50370955)
more likely the bugs will shift complexity. this has happened before, but slower. then that added complexity will make the new backdoors and 0days even more expensive again.

in the beginning, ppl didnt know a lot, and default passwords and stack overflows were 0days.

then awareness came and a lot of that is actually fixed. Writing a modern exploit more often now requires many stages and a shit ton of skills and knowledge.

that will increase.

nothing will be 'fixed' in that utopian sense.

Re:AI is forcing us to pay off 40 years of technical debt by ChuckMcM on Wednesday November 04, 2026 @03:22PM (#50370963)
As a testing tool, yes, post AI software is going to be more robust in the face of attack. We saw this when Metasploit became a thing, it provided an easy way for web site owners to test their stack against 'known problems.' I think that as a rule, we won't get a lot of action on this until we change the laws around incidental damages liability with regards to software.

It is also unfortunate than in more than half the cases where AI provides a 'fix' that fix breaks something else, so my guess is this is going to be 90% human labor to correct, at least initially.

Re:AI is forcing us to pay off 40 years of technical debt by hn_submit on Wednesday November 04, 2026 @04:59PM (#50372134)
I was thinking that intelligence agencies and "security" companies like Celebrite must be worried. If eventually all vulnerabilities are patched there will not be any avenue for them to gain access to adversaries' computers.

I predicted long ago that when computers become totally secure intelligence and LEA will lobby for mandatory backdoors, possibly through secret courts.

Re:AI is forcing us to pay off 40 years of technical debt by walrus01 on Wednesday November 04, 2026 @07:10PM (#50373243)
I would be shocked if there isn't a big team of people at the NSA/GCHQ, etc, right now monitoring all the advanced-LLM discovered holes in commonly used software that they might have already been using for 10 or 15 years without anyone knowing about it. And writing daily reports basically saying "cross this one off the list, it's getting patched by debian, RHEL, etc".
Re:AI is forcing us to pay off 40 years of technical debt by jitbit on Thursday November 05, 2026 @01:41AM (#50375936)