News for hackers. Stuff that matters.
Re:QEMU: Define policy forbidding use of AI code generators by JonChesterfield on Wednesday June 25, 2025 @08:02PM (#44382974)
Interesting. Harder line than the LLVM one found at https://llvm.org/docs/DeveloperPolicy.html#ai-generated-cont...

I'm very old man shouting at clouds about this stuff. I don't want to review code the author doesn't understand and I don't want to merge code neither of us understand.

Re:QEMU: Define policy forbidding use of AI code generators by compton93 on Wednesday June 25, 2025 @08:15PM (#44383040)
I don't want to review code the author doesn't understand

This really bothers me. I've had people ask me to do some task except they get AI to provide instructions on how to do the task and send me the instructions, rather than saying "Hey can you please do X". It's insulting.

Re:QEMU: Define policy forbidding use of AI code generators by andy99 on Wednesday June 25, 2025 @08:29PM (#44383112)
Had someone higher up ask about something in my area of expertise. I said I didn't think is was possible, he followed up with a chatGPT conversation he had where it "gave him some ideas that we could use as an approach", as if that was some useful insight.

This is the same people that think that "learning to code" is a translation issue they don't have time for as opposed to experience they don't have.

Re:QEMU: Define policy forbidding use of AI code generators by a4isms on Wednesday June 25, 2025 @08:58PM (#44383252)
> This is the same people that think that "learning to code" is a translation issue they don't have time for as opposed to experience they don't have.

This is very, very germane and a very quotable line. And these people have been around from long before LLMs appeared. These are the people who dash off an incomplete idea on Friday afternoon and expect to see a finished product in production by next Tuesday, latest. They have no self-awareness of how much context and disambiguation is needed to go from "idea in my head" to working, deterministic software that drives something like a process change in a business.

Re:QEMU: Define policy forbidding use of AI code generators by bobjordan on Wednesday June 25, 2025 @09:27PM (#44383411)
You can change "software" to "hardware" and this is still an all too common viewpoint, even for engineers that should know better.
Re:QEMU: Define policy forbidding use of AI code generators by 1dom on Thursday June 26, 2025 @04:21AM (#44385328)
The unfortunate truth is that approach does work, sometimes. It's really easy and common for capable engineers to think their way out of doing something because of all the different things they can think about it.

Sometimes, an unreasonable dumbass whose only authority comes from corporate heirarchy is needed to mandate the engineers start chipping away at the tasks. If they weren't a dumbass, they'd know the unreasonable thing they're mandating, and if they weren't unreasonable, they wouldn't mandate the someone does it.

I am an an engineer. "Sometimes" could be swapped for "rarely" above, but the point still stands: as much frustration as I have towards those people, they do occasionally lead to the impossible being delivered. But then again, a stopped clock -> twice a day etc.

Re:QEMU: Define policy forbidding use of AI code generators by taleinat on Thursday June 26, 2025 @05:59AM (#44385818)
That approach sometimes does work, but usually very poorly and often not at all.

It can work very well when the higher-up is well informed and does have deep technical experience and understanding. Steve Jobs and Elon Musk are great, well-known examples of this. They've also provided great examples of the same approach mostly failing when applied outside of their areas of deep expertise and understanding.

Re:QEMU: Define policy forbidding use of AI code generators by lowbloodsugar on Thursday June 26, 2025 @02:17PM (#44389884)
if they're only right twice a day, you can run out of money doing stupid things before you hit midnight. in practice, there's a difference between a PHB asking a "stupid" question that leads to engineers having a lightbulb moment, vs a PHB insisting on going down a route that will never work.
Re:QEMU: Define policy forbidding use of AI code generators by candiddevmike on Wednesday June 25, 2025 @08:47PM (#44383199)
Imagine a boring dystopia where everyone is given hallucinated tasks from LLMs that may in some crazy way be feasible but aren't, and you can't argue that they're impossible without being fired since leadership lacks critical thinking.
Re:QEMU: Define policy forbidding use of AI code generators by tines on Wednesday June 25, 2025 @08:57PM (#44383246)
Reminds me of the wonderful skit, The Expert: https://www.youtube.com/watch?v=BKorP55Aqvg
Re:QEMU: Define policy forbidding use of AI code generators by dotancohen on Wednesday June 25, 2025 @10:19PM (#44383670)
That is incredibly accurate - I used to be at meetings like that monthly. Please submit this as an HN discussion.
Re:QEMU: Define policy forbidding use of AI code generators by stirfish on Wednesday June 25, 2025 @09:08PM (#44383318)
Re:QEMU: Define policy forbidding use of AI code generators by whoisthemachine on Wednesday June 25, 2025 @09:59PM (#44383580)
Unfortunately this is the most likely outcome.
Re:QEMU: Define policy forbidding use of AI code generators by turol on Thursday June 26, 2025 @02:44AM (#44384800)
That is a very good description of the Paranoia RPG.
Re:QEMU: Define policy forbidding use of AI code generators by joshstrange on Wednesday June 25, 2025 @11:27PM (#44383941)
I’ve started to experience/see this and it makes me want to scream.

You can’t dismiss it out of hand (especially with it coming from up the chain) but it takes no time at all to generate by someone who knows nothing about the problem space (or worse, just enough to be dangerous) and it could take hours or more to debunk/disprove the suggestion.

I don’t know what to call this? Cognitive DDOS? Amplified Plausibility Attack? There should be a name for it and it should be ridiculed.

Re:QEMU: Define policy forbidding use of AI code generators by whatevertrevor on Thursday June 26, 2025 @04:14AM (#44385285)
It's simply the Bullshit Asymmetry Principle/Brandolini's Law. It's just that bullshit generation speedrunners have recently discovered tool-assists.
Re:QEMU: Define policy forbidding use of AI code generators by alluro2 on Wednesday June 25, 2025 @09:04PM (#44383294)
A friend experienced a similar thing at work - he gave a well-informed assessment of why something is difficult to implement and it would take a couple of weeks, based on the knowledge of the system and experience with it - only for the manager to reply within 5 min with a screenshot of an (even surprisingly) idiotic ChatGPT reply, and a message along the lines of "here's how you can do it, I guess by the end of the day".

I know several people like this, and it seems they feel like they have god powers now - and that they alone can communicate with "the AI" in this way that is simply unreachable by the rest of the peasants.

Re:QEMU: Define policy forbidding use of AI code generators by OptionOfT on Wednesday June 25, 2025 @10:03PM (#44383594)
Same here. You throw a question in a channel. Someone responds in 1 minute with a code example that either you had laying around, or would take > 5 minutes to write.

The code example was AI generated. I couldn't find a single line of code anywhere in any codebase. 0 examples on GitHub.

And of course it didn't work.

But, it sent me on a wild goose because I trusted this person to give me a valuable insight. It pisses me off so much.

Re:QEMU: Define policy forbidding use of AI code generators by mailund on Thursday June 26, 2025 @08:43AM (#44386873)
I experienced mentioning an issue I was stuck on during standup one day, then some guy on my team DMs me a screenshot of chatGPT with text about how to solve the issue. When I explained to him why the solution he had sent me didn't make sense and wouldn't solve the issue, he sent me back the reply the LLM would give by pasting in my reply, at which point I stopped responding.

I'm just really confused what people who send LLM content to other people think they are achieving? Like if I wanted an LLM response, I would just prompt the LLM myself, instead of doing it indirectly though another person who copy/pastes back and forth.

Re:QEMU: Define policy forbidding use of AI code generators by meindnoch on Friday June 27, 2025 @07:23AM (#44395884)
The appropriate response is giving these people an LLM-generated explanation on why sending people LLM-generated slop is inappropriate and provides zero value.
Re:QEMU: Define policy forbidding use of AI code generators by AdieuToLogic on Wednesday June 25, 2025 @10:28PM (#44383716)
> I know several people like this, and it seems they feel like they have god powers now - and that they alone can communicate with "the AI" in this way that is simply unreachable by the rest of the peasants.

A far too common trap people fall into is the fallacy of "your job is easy as all you have to do is <insert trivialization here>, but my job is hard because ..."

Statistically generated text (token) responses constructed by LLM's to simplistic queries are an accelerant to the self-aggrandizing problem.

Re:QEMU: Define policy forbidding use of AI code generators by spit2wind on Thursday June 26, 2025 @06:08AM (#44385869)
Sounds like a teachable moment.

If it's that simple, sounds like you've got your solution! Go ahead and take care of it. If it fits V&V and other normal procedures, like passing tests and documentation, then we'll merge it in. Shouldn't be a problem for you since it will only take a moment.

Re:QEMU: Define policy forbidding use of AI code generators by alluro2 on Thursday June 26, 2025 @12:38PM (#44389001)
Absolutely agree :) If only he wasn't completely non-technical, managing a team of ~30 devs of varying skill levels and experience - which is the root cause of most of the issues, I assume.
Re:QEMU: Define policy forbidding use of AI code generators by latexr on Thursday June 26, 2025 @10:08AM (#44387589)
> and a message along the lines of "here's how you can do it, I guess by the end of the day".

— How about you do it, motherfucker?! If it’s that simple, you do it! And when you can’t, I’ll come down there, push your face on the keyboard, and burn your office to the ground, how about that?

— Well, you don’t have to get mean about it.

— Yeah, I do have to get mean about it. Nothing worse than an ignorant, arrogant, know-it-all.

If Harlan Ellison were a programmer today.

https://www.youtube.com/watch?v=S-kiU0-f0cg&t=150s

Re:QEMU: Define policy forbidding use of AI code generators by alluro2 on Thursday June 26, 2025 @12:35PM (#44388978)
Hah, that's a good clip :) Those "angry people" are really essential as an outlet for the rest of us.
Re:QEMU: Define policy forbidding use of AI code generators by colechristensen on Wednesday June 25, 2025 @10:04PM (#44383599)
People keep asking me if AI is going to take my job and recent experience shows that it very much is not. AI is great for being mostly correct and then giving someone without enough context a mostly correct way to shoot themselves in the foot.

AI further encourages the problem in DevOps/Systems Engineering/SRE where someone comes to you and says "hey can you do this for me" having come up with the solution instead of giving you the problem "hey can you help me accomplish this"... AI gives them solutions which is more steps away to detangle into what really needs to be done.

AI has knowledge, but it doesn't have taste. Especially when it doesn't have all of the context a person with experience, it just has bad taste in solutions or just the absence of taste but with the additional problem that it makes it much easier for people to do things.

Permissions on what people have access to read and permission to change is now going to have to be more restricted because not only are we dealing with folks who have limited experience with permissions, now we have them empowered by AI to do more things which are less advisable.

Re:QEMU: Define policy forbidding use of AI code generators by MoreQARespect on Thursday June 26, 2025 @09:24AM (#44387184)
The question about whether it takes jobs away is more whether one programmer with taste can multiply their productivity between ~3-15x and take the same salary while demand for coding remains constant. It's less about whether the tool can directly replace 100% of the functions of a good programmer.
Re:QEMU: Define policy forbidding use of AI code generators by alganet on Wednesday June 25, 2025 @09:31PM (#44383446)
In corporate, you are _forced_ to trust your coworker somehow and swallow it. Specially higher-ups.

In free software though, these kinds of nonsense suggestions always happened, way before AI. Just look at any project mailing list.

It is expected that any new suggestion will encounter some resistance, the new contributor itself should be aware of that. For serious projects specifically, the levels of skepticism are usually way higher than corporations, and that's healthy and desirable.

Re:QEMU: Define policy forbidding use of AI code generators by petesergeant on Wednesday June 25, 2025 @11:35PM (#44383965)
> Had someone higher up ask about something in my area of expertise. I said I didn't think is was possible, he followed up with a chatGPT conversation he had where it "gave him some ideas that we could use as an approach", as if that was some useful insight.

I would find it very insulting if someone did this to me, for sure, as well as a huge waste of my time.

On the other hand I've also worked with some very intransigent developers who've actively fought against things they simply didn't want to do on flimsy technical grounds, knowing it couldn't be properly challenged by the requester.

On yet another hand, I've also been subordinate to people with a small amount of technical knowledge -- or a small amount of knowledge about a specific problem -- who'll do the exact same thing without ChatGPT: fire a bunch of mid-wit ideas downstream that you have already thought about, but you then need to spend a bunch of time explaining why their hot-takes aren't good. Or the CEO of a small digital agency I worked at circa 2004 asking us if we'd ever considered using CSS for our projects (which were of course CSS heavy).

Re:QEMU: Define policy forbidding use of AI code generators by sltr on Thursday June 26, 2025 @07:11AM (#44386199)
Reminds me of "Appeal to Aithority". (not a typo)

An LLM said it, so it must be true.

https://blog.ploeh.dk/2025/03/10/appeal-to-aithority/

Re:QEMU: Define policy forbidding use of AI code generators by masfuerte on Thursday June 26, 2025 @11:04AM (#44388138)
You should send him a chatGPT critique of his management style.

(Or not, unless you enjoy workplace drama.)

Re:QEMU: Define policy forbidding use of AI code generators by itslennysfault on Thursday June 26, 2025 @04:13PM (#44390838)
At a company I used to work at I saw the CEO do this publicly (on slack) to the CTO who was an absolute expert on the topic at hand, and had spent 1000s of hours optimizing a specific system. Then, the CEO comes in and says I think this will fix our problems (link to ChatGPT convo). SOO insulting. That was the day I decided I should start looking for a new job.
Re:QEMU: Define policy forbidding use of AI code generators by nijave on Wednesday June 25, 2025 @11:03PM (#44383861)
Especially when you try to correct them and they insist AI is the correct one

Sometimes it's fun reverse engineering the directions back into various forum, Stack Overflow, and documentation fragments and pointing out how AI assembled similar things into something incorrect

Re:QEMU: Define policy forbidding use of AI code generators by windward on Thursday June 26, 2025 @08:20AM (#44386706)
It's the modern equivalent of sending a LMGTFY link, except the insult is from them being purely credulous and sincere
Re:QEMU: Define policy forbidding use of AI code generators by guappa on Thursday June 26, 2025 @09:11AM (#44387097)
My company hired a new CTO and he asked chatgpt to write some lengthy documents about "how engineering gets done in our company".

He also writes all his emails with chatgpt.

I don't bother reading.

Oddly enough he recently promoted a guy who has been fucking around with LLMs for years instead of working as his right hand man.

Re:QEMU: Define policy forbidding use of AI code generators by latexr on Thursday June 26, 2025 @10:33AM (#44387842)
> Oddly enough he recently promoted a guy who has been fucking around with LLMs for years instead of working as his right hand man.

Why is that odd? From the rest of your description, it seems entirely predictable.

Re:QEMU: Define policy forbidding use of AI code generators by JonChesterfield on Thursday June 26, 2025 @09:14AM (#44387118)
That's directly lethal, in a limited sympathy with engineers that don't immediately head for the exit sort of fashion. Best of luck
Re:QEMU: Define policy forbidding use of AI code generators by guappa on Thursday June 26, 2025 @09:49AM (#44387408)
The most experienced people quit, yes. There's some other not as experienced who are left, but seeing how a noob with less seniority and a large ego is now their boss, I expect they're proof reading their CVs as well.

I think under current management immigrants have no chance of getting promoted.

Re:QEMU: Define policy forbidding use of AI code generators by dheera on Wednesday June 25, 2025 @08:33PM (#44383128)
> I don't want to review code the author doesn't understand

The author is me and my silicon buddy. We understand this stuff.

Re:QEMU: Define policy forbidding use of AI code generators by recursive on Wednesday June 25, 2025 @09:58PM (#44383571)
Of course we understand it. Just ask us!
Re:QEMU: Define policy forbidding use of AI code generators by halostatue on Wednesday June 25, 2025 @08:39PM (#44383155)
I have just started adding DCO to _all_ of the open source code that I maintain and will be adding text like this on `CONTRIBUTING.md`:

---

LLM-Generated Contribution Policy

Color is a library full of complex math and subtle decisions (some of them possibly even wrong). It is extremely important that any issues or pull requests be well understood by the submitter and that, especially for pull requests, the developer can attest to the Developer Certificate of Origin for each pull request (see LICENCE).

If LLM assistance is used in writing pull requests, this must be documented in the commit message and pull request. If there is evidence of LLM assistance without such declaration, the pull request will be declined.

Any contribution (bug, feature request, or pull request) that uses unreviewed LLM output will be rejected.

---

I am also adding this to my `SECURITY.md` entries:

---

LLM-Generated Security Report Policy

Absolutely no security reports will be accepted that have been generated by LLM agents.

---

As it's mostly just me, I'm trying to strike a balance, but my preference is against LLM generated contributions.

Re:QEMU: Define policy forbidding use of AI code generators by japhyr on Thursday June 26, 2025 @08:43AM (#44386872)
> any issues or pull requests be well understood by the submitter

I really like this phrasing, particularly in regards to PRs. I think I'll find a way to incorporate this into my projects. Even for smaller, non-critical projects, it's such a distraction to deal with people trying to make "contributions" that they don't clearly understand.

Re:QEMU: Define policy forbidding use of AI code generators by brulard on Thursday June 26, 2025 @08:22PM (#44392747)
Good luck detecting the LLM use
Re:QEMU: Define policy forbidding use of AI code generators by jitl on Wednesday June 25, 2025 @08:53PM (#44383230)
When I use LLM for coding tasks, it's like "hey please translate this YAML to structs and extract any repeated patterns to re-used variables". It's possible to do this transform with deterministic tools, but AI will do a fine job in 30s and it's trivial to test the new output is identical to the prompt input.

My high-level work is absolutely impossible to delegate to AI, but AI really helps with tedious or low-stakes incidental tasks. The other day I asked Claude Code to wire up some graphs and outlier analysis for some database benchmark result CSVs. Something conceptually easy, but takes a fair bit of time to figure out libraries and get everything hooked up unless you're already an expert at csv processing.

Re:QEMU: Define policy forbidding use of AI code generators by mistrial9 on Wednesday June 25, 2025 @09:57PM (#44383561)
oh agree and amplify this -- graphs are worlds unto themselves. some of the high end published research papers have astounding contents, for example..
Re:QEMU: Define policy forbidding use of AI code generators by mattmanser on Thursday June 26, 2025 @03:02AM (#44384921)
In my experience, AI will not do a fine job of things like this.

If the definition is past any sort of length, it will hallucinate new properties, change the names, etc. It also has a propensity to start skipping bits of the definitions by adding in comments like "/** more like this here **/"

It may work for you for small YAML files, but beware doing this for larger ones.

Worst part about all that is that it looks right to begin with because the start of the definitions will be correct, but there will be mistakes and stuff missing.

I've got a PoC hanging around where I did something similar by throwing an OpenAPI spec at an AI and telling it to generate some typescript classes because I was being lazy and couldn't be bothered to run it through a formal tool.

Took me a while to notice a lot of the definitions had subtle bugs, properties were missing and it had made a bunch of stuff up.

Re:QEMU: Define policy forbidding use of AI code generators by danielbln on Thursday June 26, 2025 @04:33AM (#44385398)
What does "AI" mean? GPT3.5 on a website, or Claude 4 Opus plugged into function calling and a harness of LSP, type checker and tool use? These are not the same, neither in terms of output quality nor in capability space. We need to be more specific about the tools we use when we discuss them. "IDEs are slow to load" wouldn't be a useful statement either.
Re:QEMU: Define policy forbidding use of AI code generators by mattmanser on Thursday June 26, 2025 @03:27PM (#44390476)
How do any of those things help with it recognizing it's hallucinated new property names?

The types don't exist outside of the yaml/json/etc.

You can't check them.

Re:QEMU: Define policy forbidding use of AI code generators by jitl on Thursday June 26, 2025 @09:15AM (#44387123)
For bigger inputs I have the AI write the new output to an adjacent file and diff the two to confirm equivalence
Re:QEMU: Define policy forbidding use of AI code generators by stefanha on Thursday June 26, 2025 @06:58AM (#44386134)
There is ongoing discussion about this topic in the QEMU AI policy: https://lore.kernel.org/qemu-devel/20250625150941-mutt-send-...
Re:QEMU: Define policy forbidding use of AI code generators by phire on Wednesday June 25, 2025 @09:07PM (#44383315)
I do use GitHub copilot on my personal projects.

But I refuse to use it as anything more than a fancy autocomplete. If it suggests code that's pretty close to what I was about to type anyway, I accept it.

This ensures that I still understand my code, that there shouldn't be any hallucination derived bugs, [1] and there really shouldn't be any questions about copyright if I was about to type it.

I find using copilot this way speeds me up. Not really because my typing is slow, it's more that I have a habit of getting bored and distracted while typing. Copilot helps me get to the next thinking/debugging part sooner.

My brain really comprehend the idea that anyone would not want to not understand their code. Especially if they are going to submit it as a PR.

And I'm a little annoyed that the existence of such people is resulting in policies that will stop me from using LLMs as autocomplete when submitting to open source projects.

I have tried using copilot in other ways. I'd love for it to be able to do menial refactoring tasks for me. But every-time I experiment, it seems to fall off the rails so fast. Or it just ends up slower than what I could do manually because it has to re-generate all my code instead of just editing it.

[1] Though I find it really interesting that if I'm in the middle of typing a bug, copilot is very happy to autocomplete it in its buggy form. Even when the bug is obvious from local context, like I've typoed a variable name.

Re:QEMU: Define policy forbidding use of AI code generators by dawnerd on Thursday June 26, 2025 @02:00AM (#44384581)
That’s how I use it too. I’ve tried to make agent mode work but it ends up taking just as long if not longer than just making the edits myself. And unless you’re very narrowly specific models like sonnet will go off track making changes you never asked for. At least gpt4.1 is pretty lazy I guess.
Re:QEMU: Define policy forbidding use of AI code generators by hsbauauvhabzb on Wednesday June 25, 2025 @09:27PM (#44383409)
You’re the exact kind of person I want to work with. Self reflective and in opposition of lazy behaviours.
Re:QEMU: Define policy forbidding use of AI code generators by rodgerd on Wednesday June 25, 2025 @09:30PM (#44383434)
This to me is interesting when it comes to free software projects; sure there are a lot of people contributing as their day job. But if you contribute or manage a project for the pleasure of it, things which undermine your enjoyment - cleaning up AI slop - are absolutely a thing to say "fuck off" over.
Re:QEMU: Define policy forbidding use of AI code generators by linsomniac on Thursday June 26, 2025 @12:38AM (#44384226)
>I don't want to review code the author doesn't understand

I get that. But the AI tooling when guided by a competent human can generate some pretty competent code, a lot of it can be driven entirely through natural language instructions. And every few months, the tooling is getting significantly more capable.

I'm contemplating what exactly it means to "understand" the code though. In the case of one project I'm working on, it's an (almost) entirely vibe-coded new storage backend to an existing VM orchestration system. I don't know the existing code base. I don't really have the time to have implemented it by hand (or I would have done it a couple years ago).

But, I've set up a test cluster and am running a variety of testing scenarios on the new storage backend. So I understand it from a high level design, and from the testing of it.

As an open source maintainer myself, I can imagine (thankfully I haven't been hit with it myself) how frustrating getting all sorts of low quality LLM "slop" submissions could be. I also understand that I'm going to have to review the code coming in whether or not the author of the submission understands it.

So how, as developers, do we leverage these tools as appropriate, and signal to other developers the level of quality in code. As someone who spent months tracking down subtle bugs in early Linux ZFS ports, I deeply understand that significant testing can trump human authorship and review of every line of code. ;-)

Re:QEMU: Define policy forbidding use of AI code generators by imiric on Thursday June 26, 2025 @05:44AM (#44385741)
> I'm contemplating what exactly it means to "understand" the code though.

You can't seriously be questioning the meaning of "understand"... That's straight from Jordan B. Peterson's debate playbook which does nothing but devolve the conversation into absurdism, while making the person sound smart.

> I've set up a test cluster and am running a variety of testing scenarios on the new storage backend. So I understand it from a high level design, and from the testing of it.

You understand the system as well as any user could. Your tests only prove that the system works in specific scenarios, which may very well satisfy your requirements, but they absolutely do not prove that you understand how the system works internally, nor that the system is implemented with a reliable degree of accuracy, let alone that it's not misbehaving in subtle ways or that it doesn't have security issues that will only become apparent when exposed to the public. All of this might be acceptable for a tool that you built quickly which is only used by yourself or a few others, but it's far from acceptable for any type of production system.

> As someone who spent months tracking down subtle bugs in early Linux ZFS ports, I deeply understand that significant testing can trump human authorship and review of every line of code.

This doesn't match my (~20y) experience at all. Testing is important, particularly more advanced forms like fuzzing, but it's not a failproof method of surfacing bugs. Tests, like any code, can itself have bugs, it can test the wrong things, setup or mock the environment in ways not representative of real world usage, and most importantly, can only cover a limited amount of real world scenarios. Even in teams that take testing seriously, achieving 100% coverage, even for just statements, is seen as counterproductive and as a fool's errand. Deeply thorough testing as seen in projects like SQLite is practically unheard of. Most programmers I've worked with will often only write happy path tests, if they bother writing any at all.

Which isn't to say that code review is the solution. But a human reviewing the code, building a mental model of how it works and how it's not supposed to work, can often catch issues before the code is even deployed. It is at this point that writing a test is valuable, so that that specific scenario is cemented in the checks for the software, and regressions can be avoided.

So I wouldn't say that testing "trumps" reviews, but that it's not a reliable way of detecting bugs, and that both methods should ideally be used together.

Re:QEMU: Define policy forbidding use of AI code generators by linsomniac on Thursday June 26, 2025 @04:24PM (#44390941)
You're right, "trumps" isn't the right word there. But, as you say, testing is an often neglected part of the process. There are absolutely issues that code review is going to be better at finding, particular security related ones. But, try fixing a subtle bug without a reproducible test case...