News for hackers. Stuff that matters.
Re:How to hide from the AI surveillance state with a color p... by rtkwe on Thursday April 25, 2019 @09:50AM (#19748065)
Figure 7 in the paper [0] shows something really important. The learned adversarial patch is not general at all and has to be held in a specific place with a specific orientation to function. This means it's not going to be generalizable to actual surveillance where you'll be viewed from a lot of different potential angles or say onto a shirt or jacket you can just wear.

[0] https://arxiv.org/pdf/1904.08653.pdf

Re:How to hide from the AI surveillance state with a color p... by mcv on Thursday April 25, 2019 @11:29AM (#19749159)
From what I understand, all of these methods to fool image recognition systems have to be very specifically tailored to a very specific image recognition system, which makes them completely useless for any kind of practical use.

To really avoid image recognition, you need to create patterns that disrupt the actual patterns that these systems look for. For facial recognition, make your eyes and jawline hard to find, like Dazzle makeup does. To defeat full-body recognition systems, wear clothes with heavy patterns that make it hard to distinguish where your arms, legs and head are.

Even then, it's unlikely to work from all angles and against all backgrounds. You'd need something that adapts to the background you're likely to be seen against.

Re:How to hide from the AI surveillance state with a color p... by dsfyu404ed on Thursday April 25, 2019 @02:06PM (#19750883)
I think it's worth nothing that traditional camouflage aims to break up the transition between the object and the background so the outline of the object cannot be properly seen and therefore the object cannot be picked out from the background.

Dazzle works not to prevent detection of the shape/outline but to prevent any further information from being discerned (e.g. heading, precise shape and distance).

Depending on the kind of system you're trying to fool the former approach may be far easier.

I once saw a woman wearing black and white patterned leggings that perfectly replicated the intended effect of dazzle. I think that with clothing that isn't skin tight and therefore does not perfectly match the shape of one's body it would be even easier to pull off.

Re:How to hide from the AI surveillance state with a color p... by bunderbunder on Thursday April 25, 2019 @03:02PM (#19751427)
I'm reminded a bit of O'ahu tree snails: https://en.wikipedia.org/wiki/Oʻahu_tree_snail

They have brightly patterned shells, and each one is different. One hypothesis for why this is is that it deprives the birds that eat them of a consistent pattern to look for.

Re:How to hide from the AI surveillance state with a color p... by clarkmoody on Thursday April 25, 2019 @11:58AM (#19749464)
Disco suit completely covered in mirrors. I can dig it!

More seriously: I got the book How to Survive a Robot Uprising many years ago, and it has all sorts of tips like this one for defeating various parts of a robot's sensory and locomotion systems.

Re:How to hide from the AI surveillance state with a color p... by lordnacho on Thursday April 25, 2019 @12:31PM (#19749789)
Re:How to hide from the AI surveillance state with a color p... by wool_gather on Thursday April 25, 2019 @11:40AM (#19749268)
This sounds very similar to "traditional", i.e., military, camouflage. Does camo gear help with making it hard for AI to see you, like it does with humans?
Re:How to hide from the AI surveillance state with a color p... by gonzo41 on Thursday April 25, 2019 @12:18PM (#19749650)
Seems pretty reasonable.

Basic image searches are looking for patterns so if you can have colors that break lines then you'd get the same effect. You would probably want to go with grey's and blue for city colors. Head to toe camouflage in the city puts you on the radar in other ways.

But the other trick about camouflage is to look like everyone else.

Hence why all soldiers dress the same out field and rank insignia is displayed in very mute colors on uniforms. This has the effect of hiding the officers in with the herd. Just don't be the guy holding the radio :P

Re:How to hide from the AI surveillance state with a color p... by baroffoos on Thursday April 25, 2019 @08:19PM (#19753770)
If you really wanted to go somewhere and be untrackable you could just wear religious clothing that covers your face and body. That way you blend in with the whole group without looking like a crazy person with facepaint.
Re:How to hide from the AI surveillance state with a color p... by dsfyu404ed on Thursday April 25, 2019 @02:09PM (#19750910)
> Does camo gear help with making it hard for AI to see you, like it does with humans?

Camo is all relative to the background. A gillie suit tailored for the local vegetation will fool literally every form of visible spectrum attempts at detecting the wearer (you need to look for heat or scent instead). It won't work very well at the mall though.

Re:How to hide from the AI surveillance state with a color p... by pps43 on Thursday April 25, 2019 @01:06PM (#19750192)
Military camouflage like Multicam is optimized for the outdoors (forest, desert, etc.) It's unlikely to work well in an urban environment where most facial recognition takes place.
Re:How to hide from the AI surveillance state with a color p... by colordrops on Thursday April 25, 2019 @11:37AM (#19749240)
And they will also use gait detection and cross reference with other data. It's a lost cause.
Re:How to hide from the AI surveillance state with a color p... by jfk13 on Thursday April 25, 2019 @11:41AM (#19749287)
It's commonly claimed that putting a pebble in your shoe is a good way to disrupt gait detection. (Presumably you shouldn't always use the same pebble in the same shoe!)
Re:How to hide from the AI surveillance state with a color p... by cde-v on Thursday April 25, 2019 @11:52AM (#19749393)
Walk without rhythm, it won't attract the...
Re:How to hide from the AI surveillance state with a color p... by Doxterpepper on Thursday April 25, 2019 @12:28PM (#19749750)
Frank Herbert was preparing us for the Butlerian Jihad
Re:How to hide from the AI surveillance state with a color p... by audiometry on Thursday April 25, 2019 @09:31PM (#19754098)
We are among you.
Re:How to hide from the AI surveillance state with a color p... by wang_li on Thursday April 25, 2019 @11:39AM (#19749258)
Put on a burka and ride a hoover board.
Re:How to hide from the AI surveillance state with a color p... by bdamm on Thursday April 25, 2019 @03:17PM (#19751556)
Yeah, it seems Islam tradition solved identity recognition ages ago. It certainly makes business negotiations difficult; the burka wearer has the advantage of emitting no body language. An advantage if they are being pitched to, that is.
Re:How to hide from the AI surveillance state with a color p... by mcv on Thursday April 25, 2019 @11:39AM (#19749263)
To defeat gait detection, I suspect the only options are really long, wide skirts, or a pebble in your shoe.
Re:How to hide from the AI surveillance state with a color p... by serf on Thursday April 25, 2019 @05:31PM (#19752703)
or a wheelchair, but you're just trading identifiers.
Re:How to hide from the AI surveillance state with a color p... by mc32 on Thursday April 25, 2019 @01:10PM (#19750240)
Elevator shoes maybe?
Re:How to hide from the AI surveillance state with a color p... by bluntfang on Thursday April 25, 2019 @01:52PM (#19750729)
JNCOs?
Re:How to hide from the AI surveillance state with a color p... by Swizec on Thursday April 25, 2019 @02:20PM (#19751038)
> To defeat full-body recognition systems, wear clothes with heavy patterns that make it hard to distinguish where your arms, legs and head are.

Isn't this basically how camo defeats the human recognition system in our wetware?

Re:How to hide from the AI surveillance state with a color p... by mc32 on Thursday April 25, 2019 @01:09PM (#19750226)
Would it not be easier at some point to “simply” don a disguise ala mission impossible? The one issue is ensuring emergence is not detected (this disguise came out from this building/house).
Re:How to hide from the AI surveillance state with a color p... by TuringNYC on Thursday April 25, 2019 @03:33PM (#19751696)
I’ve heard putting a grape in your mouth/cheek (inside) will throw off facial key-point detectors.
Re:How to hide from the AI surveillance state with a color p... by mc32 on Thursday April 25, 2019 @03:43PM (#19751776)
What about a slower event like gaining of losing weight, does that frustrate such systems?
Re:How to hide from the AI surveillance state with a color p... by dillonmckay on Thursday April 25, 2019 @09:20PM (#19754059)
A Scanner Darkly suit?
Re:How to hide from the AI surveillance state with a color p... by downrightmike on Friday April 26, 2019 @04:58PM (#19761677)
capes and cowls are a classic look
Re:How to hide from the AI surveillance state with a color p... by amelius on Thursday April 25, 2019 @02:01PM (#19750823)
Just use burqa technology.
Re:How to hide from the AI surveillance state with a color p... by pizza on Thursday April 25, 2019 @10:33AM (#19748552)
CV Dazzle [0] is/was a style of makeup that defeated facial recognition, and it seemed to work from multiple angles. Unfortunately it was released something like 5 years ago so I'm certain it won't withstand today's state of the art techniques. Looks like it was never really tested to work against deep learning-based techniques.

That said, I think somebody could very easily come up with an adversarial makeup camouflage recommender. Imagine an interactive visualization of the regions of confidence of a facial recommendation system, hooked up to your webcam. You could have a visual overlay of where to apply make up to most damage the classifier's confidence of your identity.

[0] https://cvdazzle.com/

Re:How to hide from the AI surveillance state with a color p... by pandemic_region on Thursday April 25, 2019 @10:52AM (#19748763)
thing is, when you walk around on the street looking like the people on their website you don't actually need surveillance camera's because every single person will remember seeing you.
Re:How to hide from the AI surveillance state with a color p... by mcv on Thursday April 25, 2019 @11:32AM (#19749194)
It's meant to make you hard to recognise by machines. People are fine.

At the very least, this could justify weird fashions in cyberpunk and other dystopian settings.

Re:How to hide from the AI surveillance state with a color p... by andai on Thursday April 25, 2019 @01:32PM (#19750490)
Looking through the pictures I was thinking, there's parts of the world where people just dress that way.
Re:How to hide from the AI surveillance state with a color p... by ramraj07 on Thursday April 25, 2019 @01:43PM (#19750615)
I feel like if the facial recognition systems are that good, it means if I can recognize a face, then so can it
Re:How to hide from the AI surveillance state with a color p... by mcv on Thursday April 25, 2019 @08:21PM (#19753775)
I don't think that's true. I'm no expert on facial recognition, but I believe those systems look at more specific details, like the corners of your eyes and mouth, and where they are relative to your jawline. They're less interested in things like "could this be part of a cheek? does that hair cover a head? does the picture as a whole make sense?". They're very precise (more than we are) at measuring the exact locations of specific features, but less good at checking if the picture as a whole could be hiding a person.

So they're better than us at some things, but can still fail dramatically at things that seem trivial to us.

Re:How to hide from the AI surveillance state with a color p... by Bartweiss on Thursday April 25, 2019 @11:24AM (#19749105)
It's certainly not a way to stay stealthy, yeah. And frankly it's probably worse at defeating face recognition than wearing a bulky hoody and staring at your shoes while you walk. I don't think this will be identity-concealing except maybe at some cybergoth raves...

It's an awfully cool project, though; both artistic and a transformation-resilient adversarial input.

Re:How to hide from the AI surveillance state with a color p... by soulofmischief on Thursday April 25, 2019 @02:31PM (#19751139)
The intersection of high fashion, cutting-edge technology, political commentary, and the eternal war for human rights is an incredible thing.

Does anyone know of any other such projects in the same vein?

Re:How to hide from the AI surveillance state with a color p... by soulofmischief on Thursday April 25, 2019 @02:29PM (#19751122)
As Randall Monroe illustrates here: https://xkcd.com/1105/

I guess the solution could eventually be digital paint which rapidly and randomly alters itself, something akin to the scramble suits from A Scanner Darkly. https://www.dailymotion.com/video/xqrvzb

Re:How to hide from the AI surveillance state with a color p... by Zaphods on Thursday April 25, 2019 @10:40AM (#19748627)
That CV Dazzle project is fascinating. The link to the warship Dazzle camouflage is also hilarious in the sense that that is what people have to turn to in 2019.

It reminds me of the comic book The Private Eye by Brian K Vaughn. In that story the cloud "bursts" and online privacy evaporates overnight so everyone turns to intense camouflage to protect their identity. (https://en.wikipedia.org/wiki/The_Private_Eye)

Re:How to hide from the AI surveillance state with a color p... by rtkwe on Thursday April 25, 2019 @10:49AM (#19748737)
Does face detection today use the same kind of trained neural nets that YoLo or others use? Watching this video [0] from their site it seems it's using a much more static algorithm trying to detect particular features which is what the CV Dazzle makeup aims to disrupt. As far as I understand one of the benefits of the neural net models is that they're less reliant on defined features than the older CV models.

[0] https://vimeo.com/12774628

Re:How to hide from the AI surveillance state with a color p... by RugnirViking on Thursday April 25, 2019 @10:49AM (#19748728)
On the website it talks about openCV and how to fool that, as well as the general techniques used. I still think from the tips shown that it would be very effective today. For exaple, it talks about how the most distinct features of a face are the nose and eyes, and that hiding or obscuring them works well.

Newer technology likely gets much better at spotting noses and eyes, but taking them entirely out of the picture probably helps. Also the asymmetry I can imagine helps a lot.

Re:How to hide from the AI surveillance state with a color p... by Tade0 on Thursday April 25, 2019 @10:56AM (#19748816)
This style retcons all those cyberpunk fashion accessories beautifully.
Re:How to hide from the AI surveillance state with a color p... by CharlesColeman on Thursday April 25, 2019 @02:19PM (#19751026)
CV Dazzle is perfect for the cyberpunk future that will never happen.
Re:How to hide from the AI surveillance state with a color p... by HeWhoLurksLate on Thursday April 25, 2019 @10:20AM (#19748404)
Well, I guess that that would be the next step.

Another problem is that the minute that AI-proof clothing goes mass market is the minute it stops working (and for that reason, I suppose that you wouldn't want to have a product image, either.)

Re:How to hide from the AI surveillance state with a color p... by NotPaidToPost on Thursday April 25, 2019 @11:04AM (#19748897)
The minute clothing that is really effective against AI video surveillance is available when AI video surveillance is widespread is the minute it will become a criminal offence to sell or wear such clothing...
Re:How to hide from the AI surveillance state with a color p... by erikpukinskis on Thursday April 25, 2019 @11:27AM (#19749140)
Here's a better question:

Will the book, "How To Make AI-proof Clothing" stop working the minute it is published, or will it teach generalizable skills.

It would seem unfair to pit a static object (prefab clothes) against a dynamic opponent (person detection AI). Better to compare two intelligent opponents.

Re:How to hide from the AI surveillance state with a color p... by mkagenius on Thursday April 25, 2019 @12:47PM (#19749959)
> AI-proof clothing goes mass market is the minute it stops working

What prevents GAN's from learning a new patch for them ?

Re:How to hide from the AI surveillance state with a color p... by HeWhoLurksLate on Sunday April 28, 2019 @05:10PM (#19773701)
That's the point.
Re:How to hide from the AI surveillance state with a color p... by rtkwe on Thursday April 25, 2019 @10:42AM (#19748656)
I'm not 100% sure a static image on cloth will ever work well for that kind of general countermeasure. So far all adversarial stuff except the dazzle camouflage face paint require pretty precise position or view relative to the object being labeled.
Re:How to hide from the AI surveillance state with a color p... by 317070 on Thursday April 25, 2019 @11:57AM (#19749445)
It is already reasonably robust though: https://www.youtube.com/watch?v=MIbFvK2S9g8 It is not magic, but I can imagine the method being extended to be more robust to rotation/shearing (by improving the metric being optimized for).
Re:How to hide from the AI surveillance state with a color p... by rtkwe on Thursday April 25, 2019 @02:53PM (#19751356)
I wouldn't call having to keep it mostly level and centered at hip height robust in the slightest. Check out around 0:35 in that video where he starts moving it around once he rotates it just a little out of orientation (both directly towards the camera which seems very important and also the slight <20 degree rotation) that breaks the patch and YoLo figures out it's a person. Or again at 0:55 approx where it's moved slightly to the side it again breaks pretty immediately.
Re:How to hide from the AI surveillance state with a color p... by Krasnol on Thursday April 25, 2019 @12:02PM (#19749507)
I can't believe he didn't move it higher or lower!!
Re:How to hide from the AI surveillance state with a color p... by rtkwe on Thursday April 25, 2019 @02:58PM (#19751399)
He did once but it broken the patch and YoLo correctly labelled his torso so he put it back down. They say directly in the paper that it's quite sensitive to the position of the patch relative to the bounding box of the detected object.
Re:How to hide from the AI surveillance state with a color p... by asdfasgasdgasdg on Thursday April 25, 2019 @01:43PM (#19750612)
More to the point, you won't have access to the actual surveillance network's AI, so you won't be able to train your patch adversarially in a reasonable amount of time.
Re:How to hide from the AI surveillance state with a color p... by weaklearner on Thursday April 25, 2019 @11:29AM (#19749155)
eh some adversarial inputs are very robust to perturbations/orientation. see the famous turtle video.
Re:How to hide from the AI surveillance state with a color p... by rtkwe on Thursday April 25, 2019 @02:57PM (#19751391)
That was pretty impressive though it's still on a rigid surface which gives you a fixed relationship between the shape and the pattern.
Re:How to hide from the AI surveillance state with a color p... by weaklearner on Sunday April 28, 2019 @05:22PM (#19773773)
that's a good point about the rigid surface.