News for hackers. Stuff that matters.
Re:Stable Diffusion Public Release by ForrestN on Monday August 22, 2022 @03:04PM (#32555732)
I wonder/hope if a downstream effect of this technological change will be the end of the idea of a "shameful" or "humiliating" image. We all have bodies, we all have sex, and I agree that soon images of ourselves being nude/having sex etc. will proliferate because they'll be generated instantly via Siri shortcut as part of casual banter.

In a world where every celebrity is having sex with gorillas, doesn't such an image lose its charge? Will Norms and values around sex/body shaming change?

Re:Stable Diffusion Public Release by tshaddox on Monday August 22, 2022 @03:36PM (#32556151)
That seems unlikely, given that making up hurtful stories about people and transmitting them via text or voice is still a thing. Everyone knows that anyone can make up any story they want without any technology whatsoever, and yet spreading rumors is still a thing.
Re:Stable Diffusion Public Release by seydor on Monday August 22, 2022 @04:27PM (#32556760)
Not really. I can't think of a recent "leaked texts" that the participants cannot not easily and plausibly deny (e.g. elon's supposed messages to gates), or even voice messages. Even most images can already be denied as photoshop if all the witnesses agree. The only medium that is somewhat hard to deny is videos, like sex tapes, but that's also not too hard. I think there will soon be a race to make deep learning pics look completely indistinguishable from phone pics.
Re:Stable Diffusion Public Release by tshaddox on Monday August 22, 2022 @04:40PM (#32556905)
Perhaps that's somewhat true for famous people, although there are plenty of examples of false stories (without any forged evidence, literally just stories) causing real embarrassment and damage to reputation.

But it's even more true for non-famous people getting bullied in their social groups, both online and offline, and that's more what I was responding to (the "asshole friends" in the original comment).

Re:Stable Diffusion Public Release by zone411 on Monday August 22, 2022 @04:53PM (#32557084)
It'll be hard to deny crypto-signed photos https://petapixel.com/2022/08/08/sonys-forgery-proof-tech-ad..., especially if they include metadata that distinguish photos of AI generated images from normal photos.
Re:Stable Diffusion Public Release by seydor on Monday August 22, 2022 @04:55PM (#32557103)
any camera can be hacked to plant an image in its framebuffer
Re:Stable Diffusion Public Release by dustyleary on Monday August 22, 2022 @05:23PM (#32557459)
There are a few different kinds of 'secure enclaves' implemented on chips, where you can have some degree of trust that it "cannot" be faked.

E.g. crypto wallets, hardware signing tokens, etc.

We could imagine an imaging sensor chip made by a big-name company whose reputation matters, where the imaging sensor chip does the signing itself.

So, Sony or Texas Instruments or Canon start manufacturing a CCD chip that crypto signs its output. And this chip "can't" be messed with in the same way that other crypto-signing hardware "can't" be messed with.

That doesn't seem too far-fetched to me.

* edit: As I think about it, I think more likely what happens is that e.g. Apple starts promising that any "iPhoneReality(tm)" image, which is digitally signed in a certain way, cannot have been faked and was certainly taken by the hardware that it 'promises' to be (e.g. the iPhone 25).

Regardless of how they implement it at the hardware level to maintain this guarantee, it is going to be a major target for security researchers to create fake images that carry the signature.

So, we will have some level of trust that the signature "works", because it is always being attacked by security researchers. Just like our crypto methods work today. There will be a cat-and-mouse game between manufacturers and researchers/hackers, and we'll probably know years in advance when a particular implementation is becoming "shaky".

Re:Stable Diffusion Public Release by jfoster on Monday August 22, 2022 @08:17PM (#32559014)
How would such a camera ensure you're not taking a picture of a picture?
Re:Stable Diffusion Public Release by beckingz on Tuesday August 23, 2022 @12:13AM (#32560382)
Just get a really really nice screen to display deepfakes on before photographing them
Re:Stable Diffusion Public Release by drdeca on Tuesday August 23, 2022 @03:14AM (#32561493)
Maybe have the signed content include a timestamp and location? But... GPS can be spoofed I think.
Re:Stable Diffusion Public Release by LouisSayers on Monday August 22, 2022 @07:33PM (#32558684)
In which case if found out will result in that person / publishers credibility going down the drain.

We will learn to trust sources (cryptographically signed) rather than just what we see.

Re:Stable Diffusion Public Release by zone411 on Monday August 22, 2022 @05:12PM (#32557340)
Maybe at some point for some cameras. But not soon after their release if they took steps to protect their pipeline with hardware.
Re:Stable Diffusion Public Release by nerdponx on Monday August 22, 2022 @05:11PM (#32557337)
Are journalists savvy or ethical enough to give a shit? What about the people reading/viewing/listening to the news?
Re:Stable Diffusion Public Release by Swizec on Monday August 22, 2022 @03:32PM (#32556107)
> In a world where every celebrity is having sex with gorillas, doesn't such an image lose its charge? Will Norms and values around sex/body shaming change?

I hoped this would happen with social media. Everyone says stupid shit online and everyone has past beliefs they’ve outgrown. So what’s the big deal?

Instead we went the opposite way. Everyone is super self conscious and censoring at all times because you never know who’s gonna take it out of context and make a big deal.

Re:Stable Diffusion Public Release by seydor on Monday August 22, 2022 @04:28PM (#32556775)
This is not the same though, it's about being able to deny that that photo of you is real, not that it's taken out of context.
Re:Stable Diffusion Public Release by taylorportman on Monday August 22, 2022 @06:53PM (#32558331)
It is an interesting point [the hope that values will adapt to reflect typical mischievous patterns of social dynamics within various clusters].. I used to marvel during the dotcom era at the salivating delight of "the internet never forgets" of college students caught smoking a bong and the subsequent impact on their career (virtue signalling?).. I saw hope that society could then adapt about ridiculous FUD biases. There is a strange relationship of scarcity & opportunity and these windows into souls painting a distorted picture of the darker side of our ambitions. It is a cancer. Also, humans are always testing boundary conditions - curiosity, discontent, security,insecurity. Some inherent desperation of people jockeying for the next path from frying pan to fire in the search for greener pasture breeds opportunism that seems certain to favor desperation and negativity.
Re:Stable Diffusion Public Release by Swizec on Monday August 22, 2022 @04:57PM (#32557147)
Well what’s a “real” photo?

If I take your photo and photoshop (very well) different surroundings. Is it a real photo if you?

If I photoshop your face (very well) onto a different body. Is that real?

If I feed your photos into a model that can create realistic versions of those photos in different poses or with different facial expressions. Is that real?

They all start with something that is very definitely a real photo. You can’t (yet? ever?) generate a realistic photo of a specific person from a textual description. The machinery needs a source.

Re:Stable Diffusion Public Release by kortex on Monday August 22, 2022 @05:05PM (#32557247)
Simple: a "real" photo is one in which a light field from the real world impinges on a photosensitive media (CCD, film), and directly encodes that information, with some allowance for global light levels, gain, ISO, and speed. Anything else is a modification therein. HDR, multi-exposure compositing, etc, aren't truly "real". They may be 99% real, but aren't 100% real. If you crop it, it's 99.9% real (we have models which can detect cropping and even from which region it originated, obviously it can't reconstruct the missing data).

Yes, by that definition, most photographs already aren't real.

Re:Stable Diffusion Public Release by Swizec on Monday August 22, 2022 @06:40PM (#32558202)
> Yes, by that definition, most photographs already aren't real.

What if I use no digital manipulation at all, but play around with focal lengths or perspective to produce the desired effect. Is that a real photo?

For example from covid reporting: https://twitter.com/baekdal/status/1254460167812415489

Re:Stable Diffusion Public Release by kortex on Tuesday August 23, 2022 @12:41AM (#32560541)
Sure, I'd say that's a real photo - you could easily pull it off with a single exposure of film.

Just because the photo is real, doesn't mean it's free from deception. I could take a "real video" of gorilla suit^W^W bigfoot and it'd still be deceptive.

Re:Stable Diffusion Public Release by simondotau on Monday August 22, 2022 @06:11PM (#32557953)
So if I take a photo of a photoshopped photo, it is a real photo.
Re:Stable Diffusion Public Release by cgio on Monday August 22, 2022 @07:00PM (#32558399)
It is a real photo of a photoshopped photo, not a real photo of the photoshopped photo’s subject.
Re:Stable Diffusion Public Release by seydor on Monday August 22, 2022 @05:01PM (#32557210)
A real photo is one created by photons outside the camera
Re:Stable Diffusion Public Release by Swizec on Monday August 22, 2022 @06:37PM (#32558162)
You’ll be surprised to learn that doesn’t work without some amazing tech to process the photons. Different settings will produce a different photo.

Hell, just changing focal length makes a bigg difference to what your face looks like: https://imgur.io/gallery/ZKTWi no digital manipulation required.

Which of those faces is “real”? They’re all just recording photons hitting the camera, but look very different.

It gets even worse when we start talking about colors. For example: it took cameras decades before they could accurately capture black faces. Where accurately means “an average person would say it looks right”

https://www.vox.com/2015/9/18/9348821/photography-race-bias

Edit: here's a fun example of how journalists use perspective and focal distance tricks to support their desired story angle. No digital manipulation https://twitter.com/baekdal/status/1254460167812415489

Re:Stable Diffusion Public Release by BrainVirus on Monday August 22, 2022 @05:14PM (#32557364)
>In a world where every celebrity is having sex with gorillas, doesn't such an image lose its charge?

No, because the image itself doesn't matter. What matters is how much the public wants to hate someone. If t he public is primed, any remotely plausible incriminating image will do as an excuse.

Fortunately, these images are actually far than what someone can cook up with Photoshop. Unfortunately, it's a part of a bigger trend where we get more and more tools to produce, manipulates and share information, while the tools to analyze and filter information are lagging by at least half a century.

Re:Stable Diffusion Public Release by jiggawatts on Monday August 22, 2022 @11:31PM (#32560190)
Reminds me of the novel The Light of Other Days by Stephen Baxter: https://en.wikipedia.org/wiki/The_Light_of_Other_Days

I don't generally like his style, but this novel really captivated me. Without spoiling the plot (much), the end-result of everyone being able to spy on anyone anywhere at any time is a kind of societal disinhibition, especially related to sex, nudity, or similar taboos.

Re:Stable Diffusion Public Release by numpad0 on Tuesday August 23, 2022 @12:09AM (#32560369)
> doesn't such an image lose its charge?

Yep! Individual images, and individuals in the first place, absolutely loses significance as supplies increase.

> Will Norms and values around sex/body shaming change?

The bar skyrockets! Look at TV stars from before 1995 - they should already appear below-average amateurs to modern eyes.

Re:Stable Diffusion Public Release by Fauntleroy on Monday August 22, 2022 @03:12PM (#32555824)
If we get to the point where we can't tell AI generated images from reality, I'm not sure "body shaming" will be on society's collective radar anymore.
Re:Stable Diffusion Public Release by geysersam on Monday August 22, 2022 @04:56PM (#32557123)
I bet someone said in 1830, "by the time we can send robots to Mars, body shaming will not be a thing anymore". For better and worse, that's not how we humans do things generally.
Re:Stable Diffusion Public Release by ForrestN on Monday August 22, 2022 @03:20PM (#32555944)
Why?
Re:Stable Diffusion Public Release by TylerE on Monday August 22, 2022 @03:34PM (#32556128)
Much bigger fish to fry.

Think things like forged evidence in trials.

Re:Stable Diffusion Public Release by bwest87 on Monday August 22, 2022 @04:03PM (#32556472)
Appropriately prioritizing problems has never really been society's strength...
Re:Stable Diffusion Public Release by mmmpop on Monday August 22, 2022 @04:52PM (#32557070)
That's because pesky things like "democracy" get in the way of getting shit done.

Don't you think?

Re:Stable Diffusion Public Release by telesilla on Monday August 22, 2022 @03:54PM (#32556354)
It's the right time to get into the digital forensics business.
Re:Stable Diffusion Public Release by 867-5309 on Monday August 22, 2022 @04:22PM (#32556693)
..and the Berlin gorilla nightscene
Re:Stable Diffusion Public Release by mmmpop on Monday August 22, 2022 @04:53PM (#32557078)
I second this.