Re:GIMP now has UI tests
by rafram on Thursday November 19, 2026 @11:59PM
(#50570355)
> We have 13 tests at this time.
Does GIMP have a very restrictive AI policy or something? I get not wanting to ship a gigantic pile of UI tests without thorough review, but basically any model released in the last six months would be able to write UI tests covering every single control in an afternoon.
Re:GIMP now has UI tests
by samuria on Friday November 20, 2026 @12:09AM
(#50570411)
It’s frustrating to create tests with models, not sure if it’s everyone’s experience, but every time I asked it to create tests, it makes the tests conform to the sometimes broken code. Rather than calling out what the logic/code is wrong, it will make the tests conform to whatever is already broken.
Re:GIMP now has UI tests
by Waterluvian on Friday November 20, 2026 @12:12AM
(#50570434)
It can’t magically know expectations. If the code is well documented or there’s decent associated documentation, I’ve found it has no issue writing tests.
Re:GIMP now has UI tests
by t43562 on Friday November 20, 2026 @03:42AM
(#50571879)
Tests are usually the best documentation and often the only documentation. If humans bother to write anything it should be the tests, not ambiguous human language...beyond the high level 1-liner overviews.
Re:GIMP now has UI tests
by alyandon on Friday November 20, 2026 @11:24AM
(#50577157)
I'm actually surprised at how well non-frontier/local models are able to infer the intent of code from the structure, method names and sparse random comments to the point that they are capable of writing reasonable tests.
Re:GIMP now has UI tests
by skydhash on Friday November 20, 2026 @12:46AM
(#50570631)
Prodding an agent vs doing interesting things with my time? What should I choose?
To be fair, some people like to prod. But, for me, I'd rather take hours reading manuals than do trial and error prodding for 30 minutes (even if I knew it would be that short). Yes it's not optimal in terms of time, but it's better for my soul and well being.
Re:GIMP now has UI tests
by HiPhish on Friday November 20, 2026 @01:35AM
(#50570933)
> Yes it's not optimal in terms of time, but it's better for my soul and well being.
It is also optimal in terms of time in the long run. The prodder will have to prod over and over again because he has learned nothing. You on the other hand will actually understand what is going on and will be able to either do it yourself or give precise instructions to the machine next time. Don't let yourself become a meat proxy.
Re:GIMP now has UI tests
by doginasuit on Friday November 20, 2026 @01:16AM
(#50570820)
The problem I've had is even when it can explain back the issue, it still writes for itself awful instructions with extra fluff, strange points of focus, and borderline misinterpretations of what I said.
Maybe that's not a big deal, they can still be generally useful, but they seem important to commit with the project if they will be used going forward. I hate the idea of a massive amount of slop riding along with the code, and slop begets slop.
The idea I'm chasing now is writing the documents myself with the hope that enough examples and a document about writing documents will be enough to allow it to write clearly.
Re:GIMP now has UI tests
by alerighi on Friday November 20, 2026 @03:29AM
(#50571773)
True. It's tough useful to build non-regression tests, that is build tests that test the current behavior, assuming it correct, to possibly spot bugs in the future.
Re:GIMP now has UI tests
by desterothx on Friday November 20, 2026 @03:31AM
(#50571782)
Yeah, i'm sure they want to burn their own tokens, deny others to use AI, to hog all that foss money for themselves. Definitely not related to not wanting to review 10k ai generated prs no siree
Re:GIMP now has UI tests
by cyanydeez on Friday November 20, 2026 @08:24AM
(#50574318)
thing is, we hav emuseums, well crafted historical relics.
Having projects with properly scaffolded code, et al, will be valuable when the FAA grounds all planes for a week because of <insert all the grusome things you know this administration turns a blind eye to>.
Re:GIMP now has UI tests
by fuussssip on Friday November 20, 2026 @01:14AM
(#50570807)
It's ok to have principles. Some folks have extremely valid reasons to hold a hard no stance on AI. It's not me, but I respect that position as principled, logical, and reasoned. Just a very different set of values from me.
Re:GIMP now has UI tests
by alex43578 on Friday November 20, 2026 @01:59AM
(#50571082)
But there’s a dozen other invisible tradeoffs. It’s not a simple binary. The Amish don’t have their own grapes year round, for instance. The Amish would need to dedicate a major percentage of their population to farming, given the drastically lower productivity.
Our food supply has perfectly healthy options. People choose to buy and eat junk, then blow up to 400lbs. You can gild the lily by arguing over organic vs Amish-grown in terms of micronutrients and traces of pesticides, but even an inorganic ear of corn is 10x healthier than what the average American eats.
Re:GIMP now has UI tests
by fuussssip on Friday November 20, 2026 @02:33AM
(#50571350)
I liken it to my vegetarianism. I'm not morally against eating animals. I have no religious convictions about it either. I just look at factory farming and think "that seems like torturing animals at scale to me" and choose to not participate.
The people looking at AI and taking a "none for me thanks" stance are looking at externalities and saying they don't like them, and they dont like them enough to not participate.
Re:GIMP now has UI tests
by lukeify on Friday November 20, 2026 @03:41AM
(#50571867)
Your response is essentially a strawman. Use of an LLM doesn't need to be "vibe coding", and LLMs are perfectly capable of producing cromulent, performant, well architected code in the right conditions and in the hands of a developer who knows how to use it.
Personally I consider it bizarre because the entire thesis and history of computing, going back to the term "computer" referring to a human who did tedious arithmetic by hand, was leveraging systems to accomplish a goal. Except now. Because now for (often) vague purity reasons, we should no longer reach for that lever.
That "vague purity reason" is almost always software developers so engrossed in their art form that they are more interested in the code than the product. There's not necessarily anything wrong with that, but if your goal is to ship a product, choosing not to reach for a lever to make the product better meets my definition of "bizarre".
It's bizarre in the same sense that abstract art is be bizarre. It can be interesting, novel, and even thought provoking; but often lacks functionality or utility to make it applicable to the lives of people. That's what non-LLM projects going forward will be.
If you start with the assumption that AI is the devil, than rejecting the devil and all the fruit he offers is logical.
If you start with the assumption that AI is a tool, then finding uses for the tool is logical.
Seems to me that some people really love riding a purity spiral, and collectively they have chosen a new tool to fill the role of the impure thing to be cast out.
Re:GIMP now has UI tests
by Xirdus on Friday November 20, 2026 @01:34AM
(#50570925)
From what I've seen, it's less spiritualism and more "they're taking our jobs!" kind of fearmongering. Like all "taking our jobs" fears, whether it's logical or not depends purely on whether they're actually taking these jobs or not.
Re:GIMP now has UI tests
by fuussssip on Friday November 20, 2026 @02:30AM
(#50571333)
I think you aren't being thoughtful enough.
Someone can believe AI was trained on material in a way that violated the consent of authors and artists and musicians. Someone can see the value of the tool, but not want that value to be primarily captured by megacorps. One can believe that the tool is having a deleterious effect on students, workers, and artists of all kinds, as it's being deployed. One can't be concerned about the added environmental effects, the impact to world markets, or the shortages it causes to consumer hardware. One can be worried about the copyright implications (can AI produce copyrighted material?) and not want to risk losing their IP. One can believe that art is necessarily a human enterprise, and art produced mechanically is just images and sounds, but not art nor music.
None of these are "the tool is the devil". All of these are "the tool has externalities, and those externalities come with a cost I am not comfortable paying".
I'm a vegetarian. Not because I think eating meat is immoral, but because I believe factory farming causes undue suffering to animals and the people who raise and process those animals. So I make a choice for myself, in my own life, and don't moralize to others.
It's the same thing. Some folks are making choices for their own lives based on their values for those externalities. You value energy use differently than they do. You value art differently than they do. You value corporate control over communications differently than they do. Neither of you is right, but standing here and pretending an eminently justifiable difference of opinion is just purity signaling is boorish.
Do you think its resonnable that the Gimp project are outputting handfull of human written tests when there is a good chance that they could use a tool to write thousands of tests in an afternoon?
They may be proud of not paying the externalities that the evil megacorps are demanding, but that warm blanket of purity is no protection from being outcompeted.
I think it's a real shame that so many people have set themselves against an emerging technology for reasons that on closer analysis seem like just another round of prejudice and superstition.
Re:GIMP now has UI tests
by mepiethree on Friday November 20, 2026 @01:24AM
(#50570864)
Does free open source software “have to” serve users? You clearly aren’t the user they’re trying to serve. That’s okay though; there’s something for everyone.
It wasn't vibe coded, it evolved over millions of years. And we ended up with our eating hole right next to our breathing hole because there's no way up back out of that "decision".
Re:GIMP now has UI tests
by ngruhn on Friday November 20, 2026 @01:27AM
(#50570881)
At least DNA has a reward signal to clean up tech dept. Everything is use-it-or-loose-it. Don't use your eyes because it's always dark? Bye bye. Claude would maintain that as a fallback for all eternity.
Re:GIMP now has UI tests
by bigstrat2003 on Friday November 20, 2026 @02:01AM
(#50571102)
> You have to serve users, not hold code up as a sacred relic.
They are serving users, by not allowing AI slop. Software developed by people and not an LLM is of much higher quality, and I'm glad they are taking a stand.
Re:GIMP now has UI tests
by npteljes on Friday November 20, 2026 @06:40AM
(#50573324)
The Free Software movement itself is holding up principles as a relic. It has both helped, and hindered the movement in the past. I see no reason for them to stop.
Someone else is welcome to fork GIMP and use AI to serve the users, if they so like.
Re:GIMP now has UI tests
by locusofself on Friday November 20, 2026 @12:27AM
(#50570515)
Not using AI to at least writes tests in this day and age is crazy work. I started a desktop application 2 months ago and it has almost 3,000 tests now, MANY of them UI tests.
Re:GIMP now has UI tests
by timcambrant on Friday November 20, 2026 @12:41AM
(#50570588)
AI is a bit too excellent at writing tests. The number of tests doesn't really convey any information on test coverage. At least I've found that agents that naively improve codebases will write tests for pretty much anything, including irrelevant behavior that has little value in ensuring stability, security or correct behavior. It would probably help to run a test review stage with a strong model, where agents attempt to correct and consolidate tests to guard behavior rather than ensuring that theoretical code paths are followed.
Re:GIMP now has UI tests
by skydhash on Friday November 20, 2026 @12:52AM
(#50570668)
In my experience, designing tests cases to ensure that they're othogonal and verify your invariants (domain or technical) is very mentally taxing and not something you can truly delegate. The actual typing maybe, but testing is a lot of duplicate code and you can go far with just copy-pasting stuff around and building helpers.
Re:GIMP now has UI tests
by npteljes on Friday November 20, 2026 @06:45AM
(#50573379)
I my opinion, AI only changes the ease of writing these tests, not really the quality.
I find that the human written tests on my project were the same. We were guarding not just the business behavior but also weird cases that have nothing to do with business, and also self-evident cases that basically boil down to x=x or assert(true).
Not to mention the stupid side-effect of not updating mocks when the APIs move but tests don't test that part so they are okay for a lot of time, and suddenly after a non-related change they are not.
Re:GIMP now has UI tests
by HiPhish on Friday November 20, 2026 @01:39AM
(#50570962)
Using AI to write tests in this day and age is crazy work. The machine is great at writing tests, but the quality of the tests is awful. It will write redundant tests, it will write tests that assert too many thing in one, it will not write tests that need to be tested. It's the part where I have to clean up the most every time. Quantity is not quality, and you really don't want to skip on the quality of your quality assurance. I'm writing a React + Django full-stack application, so there should be more than enough training data out there.
Re:GIMP now has UI tests
by joegibbs on Friday November 20, 2026 @12:29AM
(#50570525)
They made a blog post to announce that they’d written thirteen unit tests? Sure, there’s value in handmade software and all that but GIMP is not really a particularly excellent piece of software - if anything was to benefit from unleashing the agents it would be GIMP.
Re:GIMP now has UI tests
by t43562 on Friday November 20, 2026 @03:48AM
(#50571926)
Lucky you. Making things testable seemed hard to me quite often and ensuring that the tests covered all the difficult bits without effectively mocking it to death so that one was testing almost nothing.
Re:GIMP now has UI tests
by altmanaltman on Friday November 20, 2026 @12:44AM
(#50570615)
The blog article doesn't say they have written thirteen unit tests.
> *GIMP already has unit tests*. A unit test checks one small part of the code, for example how GIMP reads an XCF file. But our unit tests were not opening a real window. So it coult not tell us if a dialog opens, or if a menu item did its job.
> Note that GIMP *already had tests of GUI code*, usually interacting directly with the core code, and sometimes even simulating input devices’ events (pointer movements, clicks, drags…). But nothing can beat interacting with the real interface. Furthermore such legacy tests directly hijacking core code come with their own problems, such as breaking all too often (and not because they detected a bug), all while not being able to detect whole categories of bugs.
> UI tests check the program as a whole, in the same way as you use it.
Re:GIMP now has UI tests
by flexagoon on Friday November 20, 2026 @02:21AM
(#50571263)
GIMP is far from the best FOSS image editor for many use cases. IMO for many simple editing tasks that people usually need unless they're professional photo editors, even Inkscape, a primarily vector editor, is a better photo editor than GIMP.
Re:GIMP now has UI tests
by akersten on Friday November 20, 2026 @12:30AM
(#50570532)
> We have 13 tests at this time. They check that: GIMP starts and shows its main window. The Welcome dialog opens on the correct tab. It also stays hidden when you turn off “Show on Start”.
That's great you guys. Have you tested whether anyone can actually figure out the UI once they get into the app though?
There is a reason ArtCraft took off like a rocketship and GIMP has struggled to even retain users who try to stick with it.
Low effort snide but sometimes there's really no other way to convey the feedback...
Re:GIMP now has UI tests
by dllu on Friday November 20, 2026 @12:39AM
(#50570578)
Funny how GIMP spawned the Gimp Toolkit, aka GTK, which is widely used in Linux, and yet GIMP's own UI seems to have long languished as a rather outdated design. Glad that they have tests, though, and hope they continue to improve it.
Re:GIMP now has UI tests
by ModernTimes on Friday November 20, 2026 @01:01AM
(#50570736)
Timely, as I removed Gimp from my Macbook today after successfully testing PhotoCraft [1] for a week (the AI Photoshop clone written in open-source rust which has had an absured number of updates since you last tried it).
It makes me so HAPPY to remove the dinosaur Gimp, and to run "Adobe" software for free (it's good enough for me, maybe good enough for you). I expect to lose Internet points for saying that.
Re:GIMP now has UI tests
by plasticbugs on Friday November 20, 2026 @01:11AM
(#50570789)
I have a long history with Gimp. I created Gimpshop... the Gimp maintainers did not appreciate that little stunt, I'll tell ya! :D
I have canceled my Adobe subscription as of last month and have fully moved over to Photocraft. Even if development of Photocraft stopped today, I would be able to do whatever I need to get done in Photoshop without paying Adobe or wrestling with Gimp. It's good enough for me as well. I had been using Adobe Photoshop for more than 30 years now and was bought in enough to spend a significant amount of effort making Gimp act like Photoshop. Bye Photoshop, bye Gimp, bye Gimpshop.
Re:GIMP now has UI tests
by hackshack on Friday November 20, 2026 @01:39AM
(#50570957)
Same with VectorCraft. I spent over a decade looking for an Illustrator alternative. Muscle memory and specific workflows won out. VectorCraft is extremely close.
Re:GIMP now has UI tests
by bigstrat2003 on Friday November 20, 2026 @02:04AM
(#50571128)
AI bros can't stand the thought that not everyone agrees with them about LLMs. It's like a religion to them, they feel compelled to get everyone else on board. Never mind that if they are right, it will become apparent to everyone without them having to preach.
Re:GIMP now has UI tests
by thisismyanon2 on Friday November 20, 2026 @03:29AM
(#50571771)
When a group of people relentlessly insist on hijacking any discussion to refocus the topic onto something they're into it stops becoming a preference and starts looking more like bullying at the hands of a religion or cult.
For instance:
Hey we added UI tests to GIMP
AI bros: YOU SHOULD HAVE USED AAAAAAAAAIIIIIIIIII
Re:GIMP now has UI tests
by thisismyanon2 on Friday November 20, 2026 @04:05AM
(#50572040)
So why do you need to pivot every discussion about "software development process" to AI? Do you believe that the GIMP authors have not yet heard the good word? Do you think they need to be saved from their primitive non-AI practices?
There's a difference between discussion and proselytizing.
Re:GIMP now has UI tests
by WD-42 on Friday November 20, 2026 @10:37AM
(#50576296)
Seriously. This comment thread is why I’m spending less time on HN and more on lobsters. All these fresh accounts losing their minds over Gimp not using ai, even when that’s not what the article is even about.
Re:GIMP now has UI tests
by miksuko on Friday November 20, 2026 @01:32AM
(#50570910)
AI detectors are notoriously unreliable. As someone who's read too much slop in the past few years, this doesn't strike me as AI. There's typos like "coult" instead of "could", and clunky sentences like this:
> Furthermore such legacy tests directly hijacking core code come with their own problems, such as breaking all too often (and not because they detected a bug), all while not being able to detect whole categories of bugs.
Re:GIMP now has UI tests
by alex43578 on Friday November 20, 2026 @01:50AM
(#50571028)
That’s not really a clunky sentence. While it might not be Pulitzer-worthy, it clearly conveys a set of interconnected issues. Arbitrarily splitting it into a few sentences wouldn’t make it better.
Re:GIMP now has UI tests
by TeMPOraL on Friday November 20, 2026 @03:41AM
(#50571866)
What record? Where is it? What is it based on?
Pangram is just routinely spammed in every other HN thread, but as far as I can tell, it's not much more reliable than rand()%2, and that's only for cases where the "author" doesn't even care to hide the text was generated.
It doesn't and cannot work in general case. It's trivial to make LLM write in any style, or have it prorduce arbitrary number of typos and grammar mistakes. Most people just don't bother to add an extra line to the prompt.
Re:GIMP now has UI tests
by stratos123 on Friday November 20, 2026 @04:17AM
(#50572163)
> What record? Where is it? What is it based on?
Several independent audits (not counting Pangram's own research, of course) all finding extremely low or zero false positive rates and pretty good recall:
Also, the fact that when a public bounty was placed on a known-human text of >1000 words that Pangram falsely flags as having a >75% AI content, the only example anyone found was this one:
https://twitter.com/Nition/status/2122500484007395664
> Pangram is just routinely spammed in every other HN thread, but as far as I can tell, it's not much more reliable than rand()%2
As far as you can tell... based on what?
> It doesn't and cannot work in general case. It's trivial to make LLM write in any style[...]
If you asked me two years ago whether AI detection was possible, I'd have answered no on these grounds. It turns out, however, that RLHF as it's currently done causes LLMs to collapse to very specific styles, and labs are either unwilling or unable to figure out a way to fix it, which is why both humans and models are in fact able to detect AI-written text. Base models don't have this style collapse and indeed aren't detected by Pangram, but very few people are willing to use base models. Similarly, finetuning a model to write in a specific style would probably suffice to evade detection, but very few people are willing to put in this much effort. The result is that it's hard to be sure that any given text isn't AI-written, but most AI-written text is extremely blatant.
Re:GIMP now has UI tests
by genxy on Friday November 20, 2026 @03:42AM
(#50571875)
It doesn't work now because people have brain rot and talk like AI. It only worked because they mapped a couple tics and then pumped it across the nerdfluencer sphere.
Re:GIMP now has UI tests
by basedpolymer on Friday November 20, 2026 @01:43AM
(#50570986)
I think the text was originally written entirely by AI (the structure is typical). Then it was partially rewritten.
Some clues that caught my attention on their own:
“Each test launches a real instance of GIMP and performs a small task. Then it reads the result from GIMP. If the result is incorrect, the test fails and tells us what went wrong.”
That’s classic Claude; just like what I read every day. His approach to humanizing everything
And Pangram IS conservative in its estimates of results. With a text this long, I have no doubt about its accuracy.
Re:GIMP now has UI tests
by Nnnes on Friday November 20, 2026 @02:32AM
(#50571343)
Where did you get that quote from? It definitely looks like an LLM rewrite of a human-written paragraph from the post
> Each test starts a real GIMP and does one small task. Then it reads the result from GIMP. If the result is not correct, the test fails and tells us what went wrong.
Re:GIMP now has UI tests
by stratos123 on Friday November 20, 2026 @03:15AM
(#50571658)
Huh? It does appear both in the Pangram check and in the blog, and in the first commit in the history too. Right after the "What the tests do" heading.
Re:GIMP now has UI tests
by fragmede on Friday November 20, 2026 @01:47AM
(#50571011)
Or maybe don't treat pangram as some sort of magic oracle on AI generated writing. Most recently they gave out a prize because their detector scored a poem from 2006 with the phase "the night we ate whale" repeated four thousand times, as 100% AI generated.
Re:GIMP now has UI tests
by basedpolymer on Friday November 20, 2026 @01:50AM
(#50571026)
If the only false positive Pangram has found is a text consisting of a single sentence repeated thousands of times, that reinforces my belief in Pangram's effectiveness.
Re:GIMP now has UI tests
by stratos123 on Friday November 20, 2026 @03:26AM
(#50571753)
I don't think you draw the same conclusions from this search as me. Multiple people searched for ~a week with a bounty on the line and the only long false positive they could find was this poem. Meanwhile, if Pangram wasn't extremely sure of their accuracy, they could simply, you know, not participate in the bounty. Moreover, the person who submitted that winning entry does not consider it to be in the spirit in the rules, see e.g. this thread.
Re:GIMP now has UI tests
by basedpolymer on Friday November 20, 2026 @01:54AM
(#50571051)
Pangram is currently the most reliable tool for avoiding the flood of low-quality AI content on the internet.
There are independent studies on its effectiveness.
I used it because I had strong suspicions about certain passages in this text. Otherwise, I would never have used my Pangram credits on this.
Anyone who regularly reads AI-generated text will quickly recognize the few AI quirks in the text.
Re:GIMP now has UI tests
by iLoveOncall on Friday November 20, 2026 @02:28AM
(#50571313)
The tests should simply take a screenshot and send it to an LLM with the question "Is the UI absolutely horrible?". If the answer is yes then the UI is working as expected.
Re:GIMP now has UI tests
by KingOfCoders on Friday November 20, 2026 @03:00AM
(#50571536)
I created all the designs for flyers, announcements, invitations etc. in Affinity for my wife. I migrated to Linux and didn't like any of the apps. I was lost.
Then Affinity announced they'll add Linux support.
But for some time now my wife just uses Codex/Claude to do her day-to-day nothing special design work.
I feel, just like ArtCraft, Gimp will not be relevant in some years (months?).
Re:GIMP now has UI tests
by JamesLeonis on Friday November 20, 2026 @09:58AM
(#50575581)
Are you me?! I've also happily used GIMP for that long, just swap out Affinity for Paint Shop Pro or Adobe CS. I would probably feel just as lost going back to them now.
Re:GIMP now has UI tests
by skrebbel on Friday November 20, 2026 @03:18AM
(#50571685)
There are people who want to use Gimp (or Affinity etc), and there are people who want to have used Gimp. It’ll only lose relevance for the second group.
Does GIMP have a very restrictive AI policy or something? I get not wanting to ship a gigantic pile of UI tests without thorough review, but basically any model released in the last six months would be able to write UI tests covering every single control in an afternoon.
Prod your agent first until it can explain back to you what's wrong with the tests.
Then ask your agent to write a better prompt for writing tests (and save it to an .md file)
Then reference that .md file and iterate on the tests again. It may take a couple of tries, but I've had good results with this strategy.
Ended up with a whole prompting framework.
To be fair, some people like to prod. But, for me, I'd rather take hours reading manuals than do trial and error prodding for 30 minutes (even if I knew it would be that short). Yes it's not optimal in terms of time, but it's better for my soul and well being.
It is also optimal in terms of time in the long run. The prodder will have to prod over and over again because he has learned nothing. You on the other hand will actually understand what is going on and will be able to either do it yourself or give precise instructions to the machine next time. Don't let yourself become a meat proxy.
Maybe that's not a big deal, they can still be generally useful, but they seem important to commit with the project if they will be used going forward. I hate the idea of a massive amount of slop riding along with the code, and slop begets slop.
The idea I'm chasing now is writing the documents myself with the hope that enough examples and a document about writing documents will be enough to allow it to write clearly.
It is the same like humans: if they say your code is wrong, you will hire someone else who doesn't find so many bugs. It doesn't look good.
> Of course, core developers don't need to check this monotomous checklist. This is only useful for the newcomers.
So this is saying core devs already know not to use AI, only new developers shouldn't.
It's quaint at this point. Embrace the future.
Having projects with properly scaffolded code, et al, will be valuable when the FAA grounds all planes for a week because of <insert all the grusome things you know this administration turns a blind eye to>.
Or is it just me?
You have to serve users, not hold code up as a sacred relic.
Our own DNA was vibe coded. It's a mess. Stochastic hill climbing can get pretty far, and it can reach surprising fitness.
Our food supply has perfectly healthy options. People choose to buy and eat junk, then blow up to 400lbs. You can gild the lily by arguing over organic vs Amish-grown in terms of micronutrients and traces of pesticides, but even an inorganic ear of corn is 10x healthier than what the average American eats.
The people looking at AI and taking a "none for me thanks" stance are looking at externalities and saying they don't like them, and they dont like them enough to not participate.
Personally I consider it bizarre because the entire thesis and history of computing, going back to the term "computer" referring to a human who did tedious arithmetic by hand, was leveraging systems to accomplish a goal. Except now. Because now for (often) vague purity reasons, we should no longer reach for that lever.
That "vague purity reason" is almost always software developers so engrossed in their art form that they are more interested in the code than the product. There's not necessarily anything wrong with that, but if your goal is to ship a product, choosing not to reach for a lever to make the product better meets my definition of "bizarre".
It's bizarre in the same sense that abstract art is be bizarre. It can be interesting, novel, and even thought provoking; but often lacks functionality or utility to make it applicable to the lives of people. That's what non-LLM projects going forward will be.
If you start with the assumption that AI is a tool, then finding uses for the tool is logical.
Seems to me that some people really love riding a purity spiral, and collectively they have chosen a new tool to fill the role of the impure thing to be cast out.
Someone can believe AI was trained on material in a way that violated the consent of authors and artists and musicians. Someone can see the value of the tool, but not want that value to be primarily captured by megacorps. One can believe that the tool is having a deleterious effect on students, workers, and artists of all kinds, as it's being deployed. One can't be concerned about the added environmental effects, the impact to world markets, or the shortages it causes to consumer hardware. One can be worried about the copyright implications (can AI produce copyrighted material?) and not want to risk losing their IP. One can believe that art is necessarily a human enterprise, and art produced mechanically is just images and sounds, but not art nor music.
None of these are "the tool is the devil". All of these are "the tool has externalities, and those externalities come with a cost I am not comfortable paying".
I'm a vegetarian. Not because I think eating meat is immoral, but because I believe factory farming causes undue suffering to animals and the people who raise and process those animals. So I make a choice for myself, in my own life, and don't moralize to others.
It's the same thing. Some folks are making choices for their own lives based on their values for those externalities. You value energy use differently than they do. You value art differently than they do. You value corporate control over communications differently than they do. Neither of you is right, but standing here and pretending an eminently justifiable difference of opinion is just purity signaling is boorish.
They may be proud of not paying the externalities that the evil megacorps are demanding, but that warm blanket of purity is no protection from being outcompeted.
I think it's a real shame that so many people have set themselves against an emerging technology for reasons that on closer analysis seem like just another round of prejudice and superstition.
No, that was Reinforcement Learning
They are serving users, by not allowing AI slop. Software developed by people and not an LLM is of much higher quality, and I'm glad they are taking a stand.
Someone else is welcome to fork GIMP and use AI to serve the users, if they so like.
No one "has to" do anything.
I find that the human written tests on my project were the same. We were guarding not just the business behavior but also weird cases that have nothing to do with business, and also self-evident cases that basically boil down to x=x or assert(true).
Not to mention the stupid side-effect of not updating mocks when the APIs move but tests don't test that part so they are okay for a lot of time, and suddenly after a non-related change they are not.
Gimp has millions of downloads this month. They are doing something right.
Microsoft also seems to use "models" to "test" its programs. Look how shitty they are.
AI can write tests now ? For its own software ? Can it evaluate the results ? Correctly ? /s
> *GIMP already has unit tests*. A unit test checks one small part of the code, for example how GIMP reads an XCF file. But our unit tests were not opening a real window. So it coult not tell us if a dialog opens, or if a menu item did its job.
> Note that GIMP *already had tests of GUI code*, usually interacting directly with the core code, and sometimes even simulating input devices’ events (pointer movements, clicks, drags…). But nothing can beat interacting with the real interface. Furthermore such legacy tests directly hijacking core code come with their own problems, such as breaking all too often (and not because they detected a bug), all while not being able to detect whole categories of bugs.
> UI tests check the program as a whole, in the same way as you use it.
That's great you guys. Have you tested whether anyone can actually figure out the UI once they get into the app though?
There is a reason ArtCraft took off like a rocketship and GIMP has struggled to even retain users who try to stick with it.
Low effort snide but sometimes there's really no other way to convey the feedback...
> GTK is a free and open-source project maintained by GNOME and an active community of contributors.
and
> GTK and the GTK logo are trademarks of the GNOME Foundation.
It makes me so HAPPY to remove the dinosaur Gimp, and to run "Adobe" software for free (it's good enough for me, maybe good enough for you). I expect to lose Internet points for saying that.
[1] https://getartcraft.com/apps/photocraft
I have canceled my Adobe subscription as of last month and have fully moved over to Photocraft. Even if development of Photocraft stopped today, I would be able to do whatever I need to get done in Photoshop without paying Adobe or wrestling with Gimp. It's good enough for me as well. I had been using Adobe Photoshop for more than 30 years now and was bought in enough to spend a significant amount of effort making Gimp act like Photoshop. Bye Photoshop, bye Gimp, bye Gimpshop.
I'm surprised, tbh. I understand that UI is very much an afterthought in GIMP, but I figured it'd still at least have tests.
Besides, GIMP has always been unpopular long before AI.
For instance:
Hey we added UI tests to GIMP AI bros: YOU SHOULD HAVE USED AAAAAAAAAIIIIIIIIII
There's a difference between discussion and proselytizing.
I also hated the UI, coming from Photoshop, but what I found is that when I go back to Photoshop, I'm just as lost as I was before switching to Gimp.
I'm glad that they hadn't lost their courage over the years. Gimp is a solid project, and the FOSS ecosystem would lose a real gem if they stopped.
It seems hypocritical and raises questions about whether the lead maintainers are following their own guidelines.
Huh?
> Furthermore such legacy tests directly hijacking core code come with their own problems, such as breaking all too often (and not because they detected a bug), all while not being able to detect whole categories of bugs.
Pangram is just routinely spammed in every other HN thread, but as far as I can tell, it's not much more reliable than rand()%2, and that's only for cases where the "author" doesn't even care to hide the text was generated.
It doesn't and cannot work in general case. It's trivial to make LLM write in any style, or have it prorduce arbitrary number of typos and grammar mistakes. Most people just don't bother to add an extra line to the prompt.
Several independent audits (not counting Pangram's own research, of course) all finding extremely low or zero false positive rates and pretty good recall:
https://epoch.ai/data-insights/ai-detectors-false-negatives
https://arxiv.org/html/2608.11256
https://link.springer.com/article/10.1007/s40979-026-00226-w
Also, the fact that when a public bounty was placed on a known-human text of >1000 words that Pangram falsely flags as having a >75% AI content, the only example anyone found was this one: https://twitter.com/Nition/status/2122500484007395664
> Pangram is just routinely spammed in every other HN thread, but as far as I can tell, it's not much more reliable than rand()%2
As far as you can tell... based on what?
> It doesn't and cannot work in general case. It's trivial to make LLM write in any style[...]
If you asked me two years ago whether AI detection was possible, I'd have answered no on these grounds. It turns out, however, that RLHF as it's currently done causes LLMs to collapse to very specific styles, and labs are either unwilling or unable to figure out a way to fix it, which is why both humans and models are in fact able to detect AI-written text. Base models don't have this style collapse and indeed aren't detected by Pangram, but very few people are willing to use base models. Similarly, finetuning a model to write in a specific style would probably suffice to evade detection, but very few people are willing to put in this much effort. The result is that it's hard to be sure that any given text isn't AI-written, but most AI-written text is extremely blatant.
Some clues that caught my attention on their own:
“Each test launches a real instance of GIMP and performs a small task. Then it reads the result from GIMP. If the result is incorrect, the test fails and tells us what went wrong.”
That’s classic Claude; just like what I read every day. His approach to humanizing everything
And Pangram IS conservative in its estimates of results. With a text this long, I have no doubt about its accuracy.
> Each test starts a real GIMP and does one small task. Then it reads the result from GIMP. If the result is not correct, the test fails and tells us what went wrong.
Your quote doesn't appear in your Pangram link or in the commit history for the blog https://gitlab.gnome.org/Infrastructure/gimp-web/-/commits/t...
https://x.com/max_spero_/status/2122032840204226687
https://twitter.com/Nition/status/2122500484007395664
If it went "nope! No AI here!" you'd walk away and wouldn't Pangram your comment with mentioned of Pangram.
Pangram!
I used it because I had strong suspicions about certain passages in this text. Otherwise, I would never have used my Pangram credits on this.
Anyone who regularly reads AI-generated text will quickly recognize the few AI quirks in the text.
Humans can do better. They DO better
Pangram!
It feels good when I see spelling mistakes. It feels organic, human-sourced, non-AI. It feels like a good old village again.
BTW I love GIMP for everything it did to the world of graphics work. Such an awesome thing. Thank you folks.
Then Affinity announced they'll add Linux support.
But for some time now my wife just uses Codex/Claude to do her day-to-day nothing special design work.
I feel, just like ArtCraft, Gimp will not be relevant in some years (months?).
It's a matter of getting used to things. I feel lost in Affinity tools, for example, despite having a license, I use them less and less.
So much of this tech like ui tests was built for the web, and it can be a pain to get working for plain old GUI apps