News for hackers. Stuff that matters.
Re:GIMP now has UI tests by rafram on Thursday November 19, 2026 @11:59PM (#50570355)
> We have 13 tests at this time.

Does GIMP have a very restrictive AI policy or something? I get not wanting to ship a gigantic pile of UI tests without thorough review, but basically any model released in the last six months would be able to write UI tests covering every single control in an afternoon.

Re:GIMP now has UI tests by samuria on Friday November 20, 2026 @12:09AM (#50570411)
It’s frustrating to create tests with models, not sure if it’s everyone’s experience, but every time I asked it to create tests, it makes the tests conform to the sometimes broken code. Rather than calling out what the logic/code is wrong, it will make the tests conform to whatever is already broken.
Re:GIMP now has UI tests by Waterluvian on Friday November 20, 2026 @12:12AM (#50570434)
It can’t magically know expectations. If the code is well documented or there’s decent associated documentation, I’ve found it has no issue writing tests.
Re:GIMP now has UI tests by t43562 on Friday November 20, 2026 @03:42AM (#50571879)
Tests are usually the best documentation and often the only documentation. If humans bother to write anything it should be the tests, not ambiguous human language...beyond the high level 1-liner overviews.
Re:GIMP now has UI tests by alyandon on Friday November 20, 2026 @11:24AM (#50577157)
I'm actually surprised at how well non-frontier/local models are able to infer the intent of code from the structure, method names and sparse random comments to the point that they are capable of writing reasonable tests.
Re:GIMP now has UI tests by forgotmypw17 on Friday November 20, 2026 @12:14AM (#50570444)
I recommend iterating on your prompts.

Prod your agent first until it can explain back to you what's wrong with the tests.

Then ask your agent to write a better prompt for writing tests (and save it to an .md file)

Then reference that .md file and iterate on the tests again. It may take a couple of tries, but I've had good results with this strategy.

Ended up with a whole prompting framework.

Re:GIMP now has UI tests by skydhash on Friday November 20, 2026 @12:46AM (#50570631)
Prodding an agent vs doing interesting things with my time? What should I choose?

To be fair, some people like to prod. But, for me, I'd rather take hours reading manuals than do trial and error prodding for 30 minutes (even if I knew it would be that short). Yes it's not optimal in terms of time, but it's better for my soul and well being.

Re:GIMP now has UI tests by 0xcoffee on Friday November 20, 2026 @12:55AM (#50570681)
[delayed]
Re:GIMP now has UI tests by thisismyanon2 on Friday November 20, 2026 @03:01AM (#50571540)
Perhaps because they're more interested in learning something themselves.
Re:GIMP now has UI tests by HiPhish on Friday November 20, 2026 @01:35AM (#50570933)
> Yes it's not optimal in terms of time, but it's better for my soul and well being.

It is also optimal in terms of time in the long run. The prodder will have to prod over and over again because he has learned nothing. You on the other hand will actually understand what is going on and will be able to either do it yourself or give precise instructions to the machine next time. Don't let yourself become a meat proxy.

Re:GIMP now has UI tests by doginasuit on Friday November 20, 2026 @01:16AM (#50570820)
The problem I've had is even when it can explain back the issue, it still writes for itself awful instructions with extra fluff, strange points of focus, and borderline misinterpretations of what I said.

Maybe that's not a big deal, they can still be generally useful, but they seem important to commit with the project if they will be used going forward. I hate the idea of a massive amount of slop riding along with the code, and slop begets slop.

The idea I'm chasing now is writing the documents myself with the hope that enough examples and a document about writing documents will be enough to allow it to write clearly.

Re:GIMP now has UI tests by hulitu on Friday November 20, 2026 @12:56AM (#50570686)
> Rather than calling out what the logic/code is wrong, it will make the tests conform to whatever is already broken.

It is the same like humans: if they say your code is wrong, you will hire someone else who doesn't find so many bugs. It doesn't look good.

Re:GIMP now has UI tests by alerighi on Friday November 20, 2026 @03:29AM (#50571773)
True. It's tough useful to build non-regression tests, that is build tests that test the current behavior, assuming it correct, to possibly spot bugs in the future.
Re:GIMP now has UI tests by deskglass on Friday November 20, 2026 @12:10AM (#50570422)
Re:GIMP now has UI tests by einichi on Friday November 20, 2026 @01:02AM (#50570740)
> for contributors without Developer role
Re:GIMP now has UI tests by lukeify on Friday November 20, 2026 @01:22AM (#50570855)
From the blame PR:

> Of course, core developers don't need to check this monotomous checklist. This is only useful for the newcomers.

So this is saying core devs already know not to use AI, only new developers shouldn't.

It's quaint at this point. Embrace the future.

Re:GIMP now has UI tests by Xirdus on Friday November 20, 2026 @01:28AM (#50570882)
The future seems to be blocking external contributors and running the equivalent AI agents yourself.
Re:GIMP now has UI tests by desterothx on Friday November 20, 2026 @03:31AM (#50571782)
Yeah, i'm sure they want to burn their own tokens, deny others to use AI, to hog all that foss money for themselves. Definitely not related to not wanting to review 10k ai generated prs no siree
Re:GIMP now has UI tests by cyanydeez on Friday November 20, 2026 @08:24AM (#50574318)
thing is, we hav emuseums, well crafted historical relics.

Having projects with properly scaffolded code, et al, will be valuable when the FAA grounds all planes for a week because of <insert all the grusome things you know this administration turns a blind eye to>.

Re:GIMP now has UI tests by 6wf9j on Friday November 20, 2026 @10:11AM (#50575771)
Weird, the PR author doesn't have a Developer role, he is a Contributor, and yet his commits look very much AI generated, look at this one for instance https://gitlab.gnome.org/GNOME/gimp/-/merge_requests/2909/di...

Or is it just me?

Re:GIMP now has UI tests by echelon on Friday November 20, 2026 @01:10AM (#50570784)
Meanwhile I'm watching a community of hundreds of agents reworking game engines and chat apps. And it's progressing fast.

You have to serve users, not hold code up as a sacred relic.

Our own DNA was vibe coded. It's a mess. Stochastic hill climbing can get pretty far, and it can reach surprising fitness.

Re:GIMP now has UI tests by fuussssip on Friday November 20, 2026 @01:14AM (#50570807)
It's ok to have principles. Some folks have extremely valid reasons to hold a hard no stance on AI. It's not me, but I respect that position as principled, logical, and reasoned. Just a very different set of values from me.
Re:GIMP now has UI tests by lukeify on Friday November 20, 2026 @01:25AM (#50570870)
At this point it's like the Amish. Sure I can respect their principles, but at the same time I find it bloody bizarre.
Re:GIMP now has UI tests by Xirdus on Friday November 20, 2026 @01:30AM (#50570899)
But there's no denying Amish food is much healthier and higher quality than regular store bought products (with some exceptions I guess).
Re:GIMP now has UI tests by alex43578 on Friday November 20, 2026 @01:59AM (#50571082)
But there’s a dozen other invisible tradeoffs. It’s not a simple binary. The Amish don’t have their own grapes year round, for instance. The Amish would need to dedicate a major percentage of their population to farming, given the drastically lower productivity.

Our food supply has perfectly healthy options. People choose to buy and eat junk, then blow up to 400lbs. You can gild the lily by arguing over organic vs Amish-grown in terms of micronutrients and traces of pesticides, but even an inorganic ear of corn is 10x healthier than what the average American eats.

Re:GIMP now has UI tests by fuussssip on Friday November 20, 2026 @02:33AM (#50571350)
I liken it to my vegetarianism. I'm not morally against eating animals. I have no religious convictions about it either. I just look at factory farming and think "that seems like torturing animals at scale to me" and choose to not participate.

The people looking at AI and taking a "none for me thanks" stance are looking at externalities and saying they don't like them, and they dont like them enough to not participate.

Re:GIMP now has UI tests by wavemode on Friday November 20, 2026 @02:59AM (#50571526)
[delayed]
Re:GIMP now has UI tests by lukeify on Friday November 20, 2026 @03:41AM (#50571867)
Your response is essentially a strawman. Use of an LLM doesn't need to be "vibe coding", and LLMs are perfectly capable of producing cromulent, performant, well architected code in the right conditions and in the hands of a developer who knows how to use it.

Personally I consider it bizarre because the entire thesis and history of computing, going back to the term "computer" referring to a human who did tedious arithmetic by hand, was leveraging systems to accomplish a goal. Except now. Because now for (often) vague purity reasons, we should no longer reach for that lever.

That "vague purity reason" is almost always software developers so engrossed in their art form that they are more interested in the code than the product. There's not necessarily anything wrong with that, but if your goal is to ship a product, choosing not to reach for a lever to make the product better meets my definition of "bizarre".

It's bizarre in the same sense that abstract art is be bizarre. It can be interesting, novel, and even thought provoking; but often lacks functionality or utility to make it applicable to the lives of people. That's what non-LLM projects going forward will be.

Re:GIMP now has UI tests by HlessClaudesman on Friday November 20, 2026 @01:29AM (#50570893)
If you start with the assumption that AI is the devil, than rejecting the devil and all the fruit he offers is logical.

If you start with the assumption that AI is a tool, then finding uses for the tool is logical.

Seems to me that some people really love riding a purity spiral, and collectively they have chosen a new tool to fill the role of the impure thing to be cast out.

Re:GIMP now has UI tests by Xirdus on Friday November 20, 2026 @01:34AM (#50570925)
From what I've seen, it's less spiritualism and more "they're taking our jobs!" kind of fearmongering. Like all "taking our jobs" fears, whether it's logical or not depends purely on whether they're actually taking these jobs or not.
Re:GIMP now has UI tests by fuussssip on Friday November 20, 2026 @02:30AM (#50571333)
I think you aren't being thoughtful enough.

Someone can believe AI was trained on material in a way that violated the consent of authors and artists and musicians. Someone can see the value of the tool, but not want that value to be primarily captured by megacorps. One can believe that the tool is having a deleterious effect on students, workers, and artists of all kinds, as it's being deployed. One can't be concerned about the added environmental effects, the impact to world markets, or the shortages it causes to consumer hardware. One can be worried about the copyright implications (can AI produce copyrighted material?) and not want to risk losing their IP. One can believe that art is necessarily a human enterprise, and art produced mechanically is just images and sounds, but not art nor music.

None of these are "the tool is the devil". All of these are "the tool has externalities, and those externalities come with a cost I am not comfortable paying".

I'm a vegetarian. Not because I think eating meat is immoral, but because I believe factory farming causes undue suffering to animals and the people who raise and process those animals. So I make a choice for myself, in my own life, and don't moralize to others.

It's the same thing. Some folks are making choices for their own lives based on their values for those externalities. You value energy use differently than they do. You value art differently than they do. You value corporate control over communications differently than they do. Neither of you is right, but standing here and pretending an eminently justifiable difference of opinion is just purity signaling is boorish.

Re:GIMP now has UI tests by HlessClaudesman on Friday November 20, 2026 @04:29AM (#50572247)
Do you think its resonnable that the Gimp project are outputting handfull of human written tests when there is a good chance that they could use a tool to write thousands of tests in an afternoon?

They may be proud of not paying the externalities that the evil megacorps are demanding, but that warm blanket of purity is no protection from being outcompeted.

I think it's a real shame that so many people have set themselves against an emerging technology for reasons that on closer analysis seem like just another round of prejudice and superstition.

Re:GIMP now has UI tests by fuussssip on Friday November 20, 2026 @06:20AM (#50573150)
Did you read my post at all? I don't think prejudice and superstition enter the picture in the slightest.
Re:GIMP now has UI tests by himinlomax on Friday November 20, 2026 @03:03AM (#50571551)
I'll respect them when they start accepting patches submitted as punch cards.
Re:GIMP now has UI tests by keybrd-intrrpt on Friday November 20, 2026 @01:20AM (#50570848)
> Our own DNA was vibe coded.

No, that was Reinforcement Learning

Re:GIMP now has UI tests by adastra22 on Friday November 20, 2026 @01:24AM (#50570863)
Neither, if we really want to get technical. RL is directed whereas evolution is not.
Re:GIMP now has UI tests by mepiethree on Friday November 20, 2026 @01:24AM (#50570864)
Does free open source software “have to” serve users? You clearly aren’t the user they’re trying to serve. That’s okay though; there’s something for everyone.
Re:GIMP now has UI tests by globular-toast on Friday November 20, 2026 @01:27AM (#50570877)
It wasn't vibe coded, it evolved over millions of years. And we ended up with our eating hole right next to our breathing hole because there's no way up back out of that "decision".
Re:GIMP now has UI tests by ngruhn on Friday November 20, 2026 @01:27AM (#50570881)
At least DNA has a reward signal to clean up tech dept. Everything is use-it-or-loose-it. Don't use your eyes because it's always dark? Bye bye. Claude would maintain that as a fallback for all eternity.
Re:GIMP now has UI tests by bigstrat2003 on Friday November 20, 2026 @02:01AM (#50571102)
> You have to serve users, not hold code up as a sacred relic.

They are serving users, by not allowing AI slop. Software developed by people and not an LLM is of much higher quality, and I'm glad they are taking a stand.

Re:GIMP now has UI tests by npteljes on Friday November 20, 2026 @06:40AM (#50573324)
The Free Software movement itself is holding up principles as a relic. It has both helped, and hindered the movement in the past. I see no reason for them to stop.

Someone else is welcome to fork GIMP and use AI to serve the users, if they so like.

No one "has to" do anything.

Re:GIMP now has UI tests by stratos123 on Friday November 20, 2026 @03:28AM (#50571765)
[delayed]
Re:GIMP now has UI tests by jasonvorhe on Friday November 20, 2026 @08:08AM (#50574173)
RIP GIMP, Asahi, Codeberg et al
Re:GIMP now has UI tests by locusofself on Friday November 20, 2026 @12:27AM (#50570515)
Not using AI to at least writes tests in this day and age is crazy work. I started a desktop application 2 months ago and it has almost 3,000 tests now, MANY of them UI tests.
Re:GIMP now has UI tests by timcambrant on Friday November 20, 2026 @12:41AM (#50570588)
AI is a bit too excellent at writing tests. The number of tests doesn't really convey any information on test coverage. At least I've found that agents that naively improve codebases will write tests for pretty much anything, including irrelevant behavior that has little value in ensuring stability, security or correct behavior. It would probably help to run a test review stage with a strong model, where agents attempt to correct and consolidate tests to guard behavior rather than ensuring that theoretical code paths are followed.
Re:GIMP now has UI tests by skydhash on Friday November 20, 2026 @12:52AM (#50570668)
In my experience, designing tests cases to ensure that they're othogonal and verify your invariants (domain or technical) is very mentally taxing and not something you can truly delegate. The actual typing maybe, but testing is a lot of duplicate code and you can go far with just copy-pasting stuff around and building helpers.
Re:GIMP now has UI tests by aidenialislife on Friday November 20, 2026 @12:56AM (#50570687)
Designing for testing helps as well. Pure functions for core logic, coding against interfaces etc.
Re:GIMP now has UI tests by npteljes on Friday November 20, 2026 @06:45AM (#50573379)
I my opinion, AI only changes the ease of writing these tests, not really the quality.

I find that the human written tests on my project were the same. We were guarding not just the business behavior but also weird cases that have nothing to do with business, and also self-evident cases that basically boil down to x=x or assert(true).

Not to mention the stupid side-effect of not updating mocks when the APIs move but tests don't test that part so they are okay for a lot of time, and suddenly after a non-related change they are not.

Re:GIMP now has UI tests by locusofself on Friday November 20, 2026 @01:02PM (#50579090)
I agree, some of my small projects have had an explosion of tests. It usually doesn't cause my any problems other than waiting for tests to run, but that isn't great.
Re:GIMP now has UI tests by ares623 on Friday November 20, 2026 @01:01AM (#50570732)
Look, guys, you are literally allowed to fork and go ham on the code.
Re:GIMP now has UI tests by mepiethree on Friday November 20, 2026 @01:30AM (#50570901)
Yeah if people can make a better and more popular Gimp in an afternoon, go do it.

Gimp has millions of downloads this month. They are doing something right.

Re:GIMP now has UI tests by HiPhish on Friday November 20, 2026 @01:39AM (#50570962)
Using AI to write tests in this day and age is crazy work. The machine is great at writing tests, but the quality of the tests is awful. It will write redundant tests, it will write tests that assert too many thing in one, it will not write tests that need to be tested. It's the part where I have to clean up the most every time. Quantity is not quality, and you really don't want to skip on the quality of your quality assurance. I'm writing a React + Django full-stack application, so there should be more than enough training data out there.
Re:GIMP now has UI tests by byronturncoat on Friday November 20, 2026 @09:08AM (#50574859)
Some people refuse to use AI for ethical, environmental, or social reasons. It isn't crazy to want your projects to be built by humans
Re:GIMP now has UI tests by hulitu on Friday November 20, 2026 @12:46AM (#50570627)
> any model released in the last six months would be able to write UI tests covering every single control in an afternoon.

Microsoft also seems to use "models" to "test" its programs. Look how shitty they are.

Re:GIMP now has UI tests by rafram on Friday November 20, 2026 @12:35PM (#50578647)
Why "models" in quotation marks?
Re:GIMP now has UI tests by nomilk on Friday November 20, 2026 @01:03AM (#50570752)
This raises questions of AI ethics; namely, is it conscionable to subject AI to GIMP’s UI?
Re:GIMP now has UI tests by masfuerte on Friday November 20, 2026 @11:37AM (#50577441)
Ha! We'll know that LLMs are truly intelligent when they start to despair at the moronic conversations we force them to have.