News for hackers. Stuff that matters.
Re:An image preprocessing tool to protect artworks from AI-f... by GaggiX on Thursday August 24, 2023 @09:19PM (#37256688)
These tools do not work in the real world for several reasons: first, people who train LoRA or models curate their datasets, removing adversarial noise is trivial: https://github.com/lllyasviel/AdverseCleaner ; second, if they are trying to defend themselves against training AI models, then it will probably do almost nothing at all, models trained from scratch will learn the distribution, even one where the samples have adversarial noise (which can only attack a frozen model, like a VAE), SDXL has a new VAE, so the VAE will just be more robust if there is adversarial noise on the images, because it will learn to ignore it, many other models do not have a VAE to begin with.

Also, resizing the image (as is almost always done when training the model) will probably destroy most if not all of the adversarial noise.

Re:An image preprocessing tool to protect artworks from AI-f... by brookst on Thursday August 24, 2023 @09:28PM (#37256753)
It’s hilarious that we all know DRM for video is doomed because anything someone can see can be copied.

And yet people think that somehow visual art is different; that there must be some technical solution that will keep the wrong people/computers from being able to see it, while letting the right ones in.

It is not now, and it never has been, and it never will be possible to have widespread distribution and absolute control over copies.

Re:An image preprocessing tool to protect artworks from AI-f... by hamandcheese on Thursday August 24, 2023 @10:48PM (#37257394)
> It is not now, and it never has been, and it never will be possible to have widespread distribution and absolute control over copies.

I sure hope this is true, but this strikes me as a bold statement given the ongoing war on general-purpose computing.

Re:An image preprocessing tool to protect artworks from AI-f... by Turskarama on Friday August 25, 2023 @12:00AM (#37257881)
Even if you went to such extreme lengths as encrypting it such that decryption happened on monitors, a camera with a high enough resolution could still just make an (imperfect) copy.
Re:An image preprocessing tool to protect artworks from AI-f... by hex4def6 on Friday August 25, 2023 @12:33AM (#37258114)
Scanners and printers that don't scan/print currency have been around for decades. It doesn't seem that much of a stretch to have a "do not duplicate" watermark embedded in audio/video streams that recording devices respect.

I could imagine (say) the latest and greatest video encoder consortium requiring that as a condition of licence.

This might seem overly pessimistic, but I feel like the relationship between the customer and the computing device is steadily tilting towards "consumer / user" vs "customer / owner"

Re:An image preprocessing tool to protect artworks from AI-f... by BuyMyBitcoins on Friday August 25, 2023 @01:25AM (#37258399)
One mechanism behind that is the EURion Constellation. I believe there are others out there as well.

https://en.wikipedia.org/wiki/EURion_constellation

Re:An image preprocessing tool to protect artworks from AI-f... by Turskarama on Friday August 25, 2023 @02:00AM (#37258584)
The difference there is that printed money has to be very high quality to be worth copying, so you can enforce it on the few companies which make good enough printers.

A camera on the other hand is very cheap to make. You could maybe enforce all smartphones to obey your watermark, but what about a raspberry pi?

Re:An image preprocessing tool to protect artworks from AI-f... by dotancohen on Friday August 25, 2023 @03:30PM (#37266074)
Because if the Raspberry Pi camera can not take photographs that support the current iPhone coolness (live photo, or depth, or on-viewing selectable dynamic range, or I don't know what else) because the latest codec is not licensed, then the camera will not sell. So the quality Raspberry Pi camera makers don't even sell a model that doesn't respect the copy protection.
Re:An image preprocessing tool to protect artworks from AI-f... by Turskarama on Friday August 25, 2023 @07:50PM (#37268487)
You would literally need to deprecate jpg, png, every other image format in existence to make that happen. It's not gonna happen.
Re:An image preprocessing tool to protect artworks from AI-f... by dotancohen on Monday August 28, 2023 @04:41AM (#37291386)
Only need to deprecate the ability to create such an image on the camera, not the ability to read one.

Example license phrasing:

  > To license Foobar, the licensee will refrain from manufacturing or selling devices which could be used to circumvent SuperFoo Security features, even if such functionality is not part of a device supporting Foobar itself.
Re:An image preprocessing tool to protect artworks from AI-f... by hex4def6 on Tuesday August 29, 2023 @01:18PM (#37310983)
Yeah, this is my concern.

Or, for instance, it could require SuperFoo watermark detection to run continuously, regardless of whether the encoder output is SuperFoo Codec or something like MJPG.

I think it is naive to assume that such DRM will always be crackable. I was at a recent conference on AI vision, and one big (to me) new feature that camera sensor vendors like Sony are advertising are ISP-like features directly on sensor (motion detection etc). At some point, it seems entirely possible that you couldn't even bypass something like this at the sensor level.

Re:An image preprocessing tool to protect artworks from AI-f... by brookst on Friday August 25, 2023 @07:03AM (#37260294)
There are lots of firmware/software hacks to defeat these kinds of things: https://www.pelock.com/services/reverse-engineering/how-to-o...

There may be a mild deterrence to casual users, but if the photons are reaching a human’s eyes, there are ways to capture them.

Re:An image preprocessing tool to protect artworks from AI-f... by squeaky-clean on Friday August 25, 2023 @02:07AM (#37258619)
> such extreme lengths as encrypting it such that decryption happened on monitors

This is basically already how it's done fyi.

https://en.m.wikipedia.org/wiki/High-bandwidth_Digital_Conte...

Re:An image preprocessing tool to protect artworks from AI-f... by drakythe on Friday August 25, 2023 @12:23AM (#37258041)
Isn’t an artist’s works being removed from the training set _the goal_? That’s not “trivial to get around”. That’s the whole point.

I totally believe that the folks who don’t care about artist wishes will find a way around this, but it’s a game we’ll have to let play out.

Re:An image preprocessing tool to protect artworks from AI-f... by cwkoss on Friday August 25, 2023 @12:32AM (#37258110)
It's trivial to remove the adversarial noise and train on the artwork anyways if someone chooses to.

This wouldn't remove the artists work from the database. (Unless you consider the adversarial noise a meaningful part of the art...)