News for hackers. Stuff that matters.
Re:An image preprocessing tool to protect artworks from AI-f... by billconan on Thursday August 24, 2023 @06:35PM (#37255438)
this only works for publicly released model weights, right?

can it work for closed models, like midjourney?

Re:An image preprocessing tool to protect artworks from AI-f... by version_five on Thursday August 24, 2023 @07:04PM (#37255687)
It doesn't really work for anything. It would be trivial to defeat this.
Re:An image preprocessing tool to protect artworks from AI-f... by K0balt on Thursday August 24, 2023 @07:23PM (#37255839)
While I share your reservations, I think we should either give it a whirl or wait for someone else to try adversarial processing before we dismiss it out of hand.

My guess is though that if you had a training set of processed vs unprocessed pairs that you could train an “unmister” if you wanted to.

Re:An image preprocessing tool to protect artworks from AI-f... by TheRealPomax on Thursday August 24, 2023 @07:39PM (#37255980)
Not much point in giving it a whirl when the resulting images are clearly not something you'd put in your site to show off your work. The problem with this (and glaze, etc) is that it does what it claims by ruining the image it's used on.
Re:An image preprocessing tool to protect artworks from AI-f... by spookie on Thursday August 24, 2023 @08:04PM (#37256141)
Unfortunately it's the natural progression of the web, given the unethical ways people are training their models. This is going to happen in more ways than just images.
Re:An image preprocessing tool to protect artworks from AI-f... by K0balt on Thursday August 24, 2023 @08:56PM (#37256541)
The image degradation seems like certainly a potential dealbreaker from an art perspective. Perhaps in some modalities it would be less noticeable?
Re:An image preprocessing tool to protect artworks from AI-f... by bhickey on Thursday August 24, 2023 @08:33PM (#37256357)
We should dismiss it out of hand. Any image that a human can look at can be fed to a neural net. It's just an instance of the analog hole.
Re:An image preprocessing tool to protect artworks from AI-f... by roughly on Thursday August 24, 2023 @08:44PM (#37256446)
> My guess is though that if you had a training set of processed vs unprocessed pairs that you could train an “unmister” if you wanted to.

I look forward to the masterclass in ethical justification acrobatics that would accompany such an effort

Re:An image preprocessing tool to protect artworks from AI-f... by K0balt on Thursday August 24, 2023 @08:57PM (#37256547)
Clearly you haven’t met my in-laws.
Re:An image preprocessing tool to protect artworks from AI-f... by theaiquestion on Friday August 25, 2023 @12:40AM (#37258148)
Funny enough the first one I've found that works consistently with this one(however unusably destructive) is the "whirl" filter in GIMP.

Previous adversarial methods I've beat with simple noise/blur. This one is fairly resistant to basic filters.

Re:An image preprocessing tool to protect artworks from AI-f... by openbear on Thursday August 24, 2023 @07:18PM (#37255790)
I don’t see artists replacing all the images on their websites with Mist processed versions.

Their example Van Gogh images look okay as thumbnails but are really different from the originals when viewed larger.

Overall a neat project though.

Re:An image preprocessing tool to protect artworks from AI-f... by meepmorp on Thursday August 24, 2023 @07:37PM (#37255964)
I think the thumbnails of the misted look awful, though that might be because I can see the original to compare. There seems to be weird semi-regular patterns around the images that I think I'd notice even without the comparison, though.
Re:An image preprocessing tool to protect artworks from AI-f... by soared on Thursday August 24, 2023 @07:43PM (#37255999)
I could see use cases for galleries posting images of paintings/photos that are for sale in real life, but that they don’t want copies online.
Re:An image preprocessing tool to protect artworks from AI-f... by cratermoon on Thursday August 24, 2023 @08:43PM (#37256438)
It's definitely a work-in-progress.
Re:An image preprocessing tool to protect artworks from AI-f... by msp26 on Thursday August 24, 2023 @07:18PM (#37255793)
If it's anything like Glaze, it's a complete meme. That took a lot of compute to glaze an image (with very visible artifacts) and was bypassed with some trival image processing on a shitty laptop.
Re:An image preprocessing tool to protect artworks from AI-f... by brucethemoose2 on Thursday August 24, 2023 @07:47PM (#37256029)
I don't think its meant to stop determined thieves, but rather automated web crawlers or more casual human copycats.
Re:An image preprocessing tool to protect artworks from AI-f... by polygamous_bat on Thursday August 24, 2023 @08:05PM (#37256144)
Why would automated web crawlers not throw the best de-Glazing techniques at their dataset before model training?
Re:An image preprocessing tool to protect artworks from AI-f... by greysphere on Thursday August 24, 2023 @08:20PM (#37256271)
Because it increases the cost.
Re:An image preprocessing tool to protect artworks from AI-f... by polygamous_bat on Thursday August 24, 2023 @09:53PM (#37256939)
Compared to training a model on few thousand or more GPU-hours? Probably merit a footnote, at best.
Re:An image preprocessing tool to protect artworks from AI-f... by theaiquestion on Friday August 25, 2023 @12:32AM (#37258105)
Just for context LAOIN's largest dataset is 5.8 Billion images

And you'd be spending that compute time for what will be a tiny, tiny,portion of that

Re:An image preprocessing tool to protect artworks from AI-f... by brucethemoose2 on Thursday August 24, 2023 @09:45PM (#37256883)
On the off chance that a single digit percentage of the dataset is glazed, they would probably detect and exclude, as that is easier.
Re:An image preprocessing tool to protect artworks from AI-f... by cwkoss on Friday August 25, 2023 @12:35AM (#37258122)
The technical equivalent of a decorative rope around a painting in a museum to stop theft.
Re:An image preprocessing tool to protect artworks from AI-f... by LeftHandPath on Thursday August 24, 2023 @08:43PM (#37256434)
This is incredibly similar to a paper one of my professors was working on a year or two ago: [0]

> Neural Trojans embedded in pre-trained neural networks are a harmful attack against the DNN model supply chain. They generate false outputs when certain stealthy triggers appear in the inputs. While data-poisoning attacks have been well studied in the literature, code-poisoning and model-poisoning backdoors only start to attract attention until recently.

While I agree with other commenters here that it's hard to imagine it being widely implemented at the moment, I think it's only the beginning of this type of tech. In a few years, maybe this type of data poisoning could be as ubiquitous as SSL and as subtle as webp compression artifacting.

[0]: https://dl.acm.org/doi/abs/10.1145/3548606.3560678

Re:An image preprocessing tool to protect artworks from AI-f... by kstenerud on Thursday August 24, 2023 @09:14PM (#37256646)
Cat-and-mouse.

It won't be hard to train models to recognize and compensate for this and other permutations of it. Meanwhile you've uglified your art piece.

Re:An image preprocessing tool to protect artworks from AI-f... by GaggiX on Thursday August 24, 2023 @09:19PM (#37256688)
These tools do not work in the real world for several reasons: first, people who train LoRA or models curate their datasets, removing adversarial noise is trivial: https://github.com/lllyasviel/AdverseCleaner ; second, if they are trying to defend themselves against training AI models, then it will probably do almost nothing at all, models trained from scratch will learn the distribution, even one where the samples have adversarial noise (which can only attack a frozen model, like a VAE), SDXL has a new VAE, so the VAE will just be more robust if there is adversarial noise on the images, because it will learn to ignore it, many other models do not have a VAE to begin with.

Also, resizing the image (as is almost always done when training the model) will probably destroy most if not all of the adversarial noise.

Re:An image preprocessing tool to protect artworks from AI-f... by brookst on Thursday August 24, 2023 @09:28PM (#37256753)
It’s hilarious that we all know DRM for video is doomed because anything someone can see can be copied.

And yet people think that somehow visual art is different; that there must be some technical solution that will keep the wrong people/computers from being able to see it, while letting the right ones in.

It is not now, and it never has been, and it never will be possible to have widespread distribution and absolute control over copies.

Re:An image preprocessing tool to protect artworks from AI-f... by hamandcheese on Thursday August 24, 2023 @10:48PM (#37257394)
> It is not now, and it never has been, and it never will be possible to have widespread distribution and absolute control over copies.

I sure hope this is true, but this strikes me as a bold statement given the ongoing war on general-purpose computing.

Re:An image preprocessing tool to protect artworks from AI-f... by Turskarama on Friday August 25, 2023 @12:00AM (#37257881)
Even if you went to such extreme lengths as encrypting it such that decryption happened on monitors, a camera with a high enough resolution could still just make an (imperfect) copy.
Re:An image preprocessing tool to protect artworks from AI-f... by hex4def6 on Friday August 25, 2023 @12:33AM (#37258114)
Scanners and printers that don't scan/print currency have been around for decades. It doesn't seem that much of a stretch to have a "do not duplicate" watermark embedded in audio/video streams that recording devices respect.

I could imagine (say) the latest and greatest video encoder consortium requiring that as a condition of licence.

This might seem overly pessimistic, but I feel like the relationship between the customer and the computing device is steadily tilting towards "consumer / user" vs "customer / owner"

Re:An image preprocessing tool to protect artworks from AI-f... by BuyMyBitcoins on Friday August 25, 2023 @01:25AM (#37258399)
One mechanism behind that is the EURion Constellation. I believe there are others out there as well.

https://en.wikipedia.org/wiki/EURion_constellation

Re:An image preprocessing tool to protect artworks from AI-f... by Turskarama on Friday August 25, 2023 @02:00AM (#37258584)
The difference there is that printed money has to be very high quality to be worth copying, so you can enforce it on the few companies which make good enough printers.

A camera on the other hand is very cheap to make. You could maybe enforce all smartphones to obey your watermark, but what about a raspberry pi?

Re:An image preprocessing tool to protect artworks from AI-f... by dotancohen on Friday August 25, 2023 @03:30PM (#37266074)
Because if the Raspberry Pi camera can not take photographs that support the current iPhone coolness (live photo, or depth, or on-viewing selectable dynamic range, or I don't know what else) because the latest codec is not licensed, then the camera will not sell. So the quality Raspberry Pi camera makers don't even sell a model that doesn't respect the copy protection.
Re:An image preprocessing tool to protect artworks from AI-f... by Turskarama on Friday August 25, 2023 @07:50PM (#37268487)
You would literally need to deprecate jpg, png, every other image format in existence to make that happen. It's not gonna happen.
Re:An image preprocessing tool to protect artworks from AI-f... by dotancohen on Monday August 28, 2023 @04:41AM (#37291386)
Only need to deprecate the ability to create such an image on the camera, not the ability to read one.

Example license phrasing:

  > To license Foobar, the licensee will refrain from manufacturing or selling devices which could be used to circumvent SuperFoo Security features, even if such functionality is not part of a device supporting Foobar itself.
Re:An image preprocessing tool to protect artworks from AI-f... by hex4def6 on Tuesday August 29, 2023 @01:18PM (#37310983)
Yeah, this is my concern.

Or, for instance, it could require SuperFoo watermark detection to run continuously, regardless of whether the encoder output is SuperFoo Codec or something like MJPG.

I think it is naive to assume that such DRM will always be crackable. I was at a recent conference on AI vision, and one big (to me) new feature that camera sensor vendors like Sony are advertising are ISP-like features directly on sensor (motion detection etc). At some point, it seems entirely possible that you couldn't even bypass something like this at the sensor level.

Re:An image preprocessing tool to protect artworks from AI-f... by brookst on Friday August 25, 2023 @07:03AM (#37260294)
There are lots of firmware/software hacks to defeat these kinds of things: https://www.pelock.com/services/reverse-engineering/how-to-o...

There may be a mild deterrence to casual users, but if the photons are reaching a human’s eyes, there are ways to capture them.

Re:An image preprocessing tool to protect artworks from AI-f... by squeaky-clean on Friday August 25, 2023 @02:07AM (#37258619)
> such extreme lengths as encrypting it such that decryption happened on monitors

This is basically already how it's done fyi.

https://en.m.wikipedia.org/wiki/High-bandwidth_Digital_Conte...

Re:An image preprocessing tool to protect artworks from AI-f... by drakythe on Friday August 25, 2023 @12:23AM (#37258041)
Isn’t an artist’s works being removed from the training set _the goal_? That’s not “trivial to get around”. That’s the whole point.

I totally believe that the folks who don’t care about artist wishes will find a way around this, but it’s a game we’ll have to let play out.

Re:An image preprocessing tool to protect artworks from AI-f... by cwkoss on Friday August 25, 2023 @12:32AM (#37258110)
It's trivial to remove the adversarial noise and train on the artwork anyways if someone chooses to.

This wouldn't remove the artists work from the database. (Unless you consider the adversarial noise a meaningful part of the art...)

Re:An image preprocessing tool to protect artworks from AI-f... by worrycue on Friday August 25, 2023 @03:25AM (#37259054)
AI has open a real big can of worms.

Frankly, I see AI training on publicly available images to learn a style which it will then reproduce similar to the problem of game clones.

Imagine spending months/years making a game, coming up with the concept and gameplay, tuning the gameplay, … then after release cloners makes a nigh exact copy with slight changes in artwork/text and sell it for 10% of what you are selling - which they can since they put in only a fraction of the effort - and there is nothing you can do about it since gameplay isn’t copyrightable.

Same thing here IMHO. Not an AI specific problem but AI takes “no effort” when replicating an artist’s style vs a human who at least has to practice and learn the style.

Re:An image preprocessing tool to protect artworks from AI-f... by hooverd on Friday August 25, 2023 @09:19AM (#37261387)
AI art seems great if you want to generate an 80% there stream of generic waifus, but turns out nobody wants to see that. It's like buying a coffee mug from the store and wanting praise as if you fired it yourself.
[dead]
Re:An image preprocessing tool to protect artworks from AI-f... by pawelmurias on Friday August 25, 2023 @07:37AM (#37260551)
How do you plan to detect if your work was one of the thousands it used to train itself?