News for hackers. Stuff that matters.
Re:GIMP now has UI tests by basedpolymer on Friday November 20, 2026 @01:27AM (#50570880)
The article detects AI in the text at +40%. That's a bit disappointing coming from Gimp, which prohibits the use of AI.

It seems hypocritical and raises questions about whether the lead maintainers are following their own guidelines.

Re:GIMP now has UI tests by weird-eye-issue on Friday November 20, 2026 @01:31AM (#50570906)
"The article detects AI in the text at +40%"

Huh?

Re:GIMP now has UI tests by basedpolymer on Friday November 20, 2026 @01:34AM (#50570923)
I don't know how, but my iOS keyboard has completely replaced “Pangram” with something else...
Re:GIMP now has UI tests by weird-eye-issue on Friday November 20, 2026 @04:08AM (#50572072)
Yeah, that's called autocorrect
Re:GIMP now has UI tests by miksuko on Friday November 20, 2026 @01:32AM (#50570910)
AI detectors are notoriously unreliable. As someone who's read too much slop in the past few years, this doesn't strike me as AI. There's typos like "coult" instead of "could", and clunky sentences like this:

> Furthermore such legacy tests directly hijacking core code come with their own problems, such as breaking all too often (and not because they detected a bug), all while not being able to detect whole categories of bugs.

Re:GIMP now has UI tests by alex43578 on Friday November 20, 2026 @01:50AM (#50571028)
That’s not really a clunky sentence. While it might not be Pulitzer-worthy, it clearly conveys a set of interconnected issues. Arbitrarily splitting it into a few sentences wouldn’t make it better.
Re:GIMP now has UI tests by ChrisRR on Friday November 20, 2026 @04:52AM (#50572428)
It is definitely a clunky sentence, and doesn't read much like a claude commmit message
Re:GIMP now has UI tests by stratos123 on Friday November 20, 2026 @03:12AM (#50571628)
Old AI detectors are notoriously unreliable, but not Pangram, which has an extensive record of reliability.
Re:GIMP now has UI tests by wdutch on Friday November 20, 2026 @03:31AM (#50571787)
Why don't you let me fix you some of this Mococoa drink? All natural cocoa beans from the upper slopes of Mount Nicaragua. No artificial sweeteners.
Re:GIMP now has UI tests by TeMPOraL on Friday November 20, 2026 @03:41AM (#50571866)
What record? Where is it? What is it based on?

Pangram is just routinely spammed in every other HN thread, but as far as I can tell, it's not much more reliable than rand()%2, and that's only for cases where the "author" doesn't even care to hide the text was generated.

It doesn't and cannot work in general case. It's trivial to make LLM write in any style, or have it prorduce arbitrary number of typos and grammar mistakes. Most people just don't bother to add an extra line to the prompt.

Re:GIMP now has UI tests by stratos123 on Friday November 20, 2026 @04:17AM (#50572163)
> What record? Where is it? What is it based on?

Several independent audits (not counting Pangram's own research, of course) all finding extremely low or zero false positive rates and pretty good recall:

https://epoch.ai/data-insights/ai-detectors-false-negatives

https://arxiv.org/html/2608.11256

https://link.springer.com/article/10.1007/s40979-026-00226-w

Also, the fact that when a public bounty was placed on a known-human text of >1000 words that Pangram falsely flags as having a >75% AI content, the only example anyone found was this one: https://twitter.com/Nition/status/2122500484007395664

> Pangram is just routinely spammed in every other HN thread, but as far as I can tell, it's not much more reliable than rand()%2

As far as you can tell... based on what?

> It doesn't and cannot work in general case. It's trivial to make LLM write in any style[...]

If you asked me two years ago whether AI detection was possible, I'd have answered no on these grounds. It turns out, however, that RLHF as it's currently done causes LLMs to collapse to very specific styles, and labs are either unwilling or unable to figure out a way to fix it, which is why both humans and models are in fact able to detect AI-written text. Base models don't have this style collapse and indeed aren't detected by Pangram, but very few people are willing to use base models. Similarly, finetuning a model to write in a specific style would probably suffice to evade detection, but very few people are willing to put in this much effort. The result is that it's hard to be sure that any given text isn't AI-written, but most AI-written text is extremely blatant.

Re:GIMP now has UI tests by genxy on Friday November 20, 2026 @03:42AM (#50571875)
It doesn't work now because people have brain rot and talk like AI. It only worked because they mapped a couple tics and then pumped it across the nerdfluencer sphere.
Re:GIMP now has UI tests by raincole on Friday November 20, 2026 @01:38AM (#50570952)
All the articles on HN that I suspected as AI-generated got ~100%. So a 40% means likely no AI in my dictionary.
Re:GIMP now has UI tests by basedpolymer on Friday November 20, 2026 @01:43AM (#50570986)
I think the text was originally written entirely by AI (the structure is typical). Then it was partially rewritten.

Some clues that caught my attention on their own:

“Each test launches a real instance of GIMP and performs a small task. Then it reads the result from GIMP. If the result is incorrect, the test fails and tells us what went wrong.”

That’s classic Claude; just like what I read every day. His approach to humanizing everything

And Pangram IS conservative in its estimates of results. With a text this long, I have no doubt about its accuracy.

Re:GIMP now has UI tests by Nnnes on Friday November 20, 2026 @02:32AM (#50571343)
Where did you get that quote from? It definitely looks like an LLM rewrite of a human-written paragraph from the post

> Each test starts a real GIMP and does one small task. Then it reads the result from GIMP. If the result is not correct, the test fails and tells us what went wrong.

Your quote doesn't appear in your Pangram link or in the commit history for the blog https://gitlab.gnome.org/Infrastructure/gimp-web/-/commits/t...

Re:GIMP now has UI tests by stratos123 on Friday November 20, 2026 @03:15AM (#50571658)
Huh? It does appear both in the Pangram check and in the blog, and in the first commit in the history too. Right after the "What the tests do" heading.
Re:GIMP now has UI tests by stratos123 on Friday November 20, 2026 @03:14AM (#50571641)
[delayed]
Re:GIMP now has UI tests by fragmede on Friday November 20, 2026 @01:47AM (#50571011)
Or maybe don't treat pangram as some sort of magic oracle on AI generated writing. Most recently they gave out a prize because their detector scored a poem from 2006 with the phase "the night we ate whale" repeated four thousand times, as 100% AI generated.

https://x.com/max_spero_/status/2122032840204226687

Re:GIMP now has UI tests by basedpolymer on Friday November 20, 2026 @01:50AM (#50571026)
If the only false positive Pangram has found is a text consisting of a single sentence repeated thousands of times, that reinforces my belief in Pangram's effectiveness.
Re:GIMP now has UI tests by stratos123 on Friday November 20, 2026 @03:26AM (#50571753)
I don't think you draw the same conclusions from this search as me. Multiple people searched for ~a week with a bounty on the line and the only long false positive they could find was this poem. Meanwhile, if Pangram wasn't extremely sure of their accuracy, they could simply, you know, not participate in the bounty. Moreover, the person who submitted that winning entry does not consider it to be in the spirit in the rules, see e.g. this thread.

https://twitter.com/Nition/status/2122500484007395664

Re:GIMP now has UI tests by cadamsdotcom on Friday November 20, 2026 @01:48AM (#50571017)
At the risk of being obvious, Pangram has heavy incentive to give you something to say about Pangram's Pangramming of text you plug into Pangram.

If it went "nope! No AI here!" you'd walk away and wouldn't Pangram your comment with mentioned of Pangram.

Pangram!

Re:GIMP now has UI tests by basedpolymer on Friday November 20, 2026 @01:54AM (#50571051)
Pangram is currently the most reliable tool for avoiding the flood of low-quality AI content on the internet. There are independent studies on its effectiveness.

I used it because I had strong suspicions about certain passages in this text. Otherwise, I would never have used my Pangram credits on this.

Anyone who regularly reads AI-generated text will quickly recognize the few AI quirks in the text.

Humans can do better. They DO better

Re:GIMP now has UI tests by cadamsdotcom on Friday November 20, 2026 @02:00AM (#50571089)
Thank you for your Pangram primer, I had no idea!

Pangram!

Re:GIMP now has UI tests by stratos123 on Friday November 20, 2026 @03:18AM (#50571689)
[delayed]