News for hackers. Stuff that matters.
Re:There is no evil like reCAPTCHA by ceejayoz on Monday August 05, 2019 @12:31PM (#20615467)
It's very frustrating that there's no "your AI is an idiot, there isn't one" button. I saw an example of one that said "click the tiles containing the bus" where it was clear what the AI thought was a bus, but it definitely wasn't.
Re:There is no evil like reCAPTCHA by dwyerm on Monday August 05, 2019 @12:46PM (#20615616)
This reminds me of Janelle C. Shane's work on AI[1]. Computer vision's been learning based on the photos that people take, not the visions that people see, and this is giving AI a preference for photogenics instead of reality.

People generally don't take pictures of rolling green hillsides. But they very often take pictures of rolling green hillsides with sheep on them. So if you ask the robot to draw a picture of rolling green hillsides, it will include sheep. Or, if you ask it to draw a picture of the savanna, it will want to include giraffes.

Now you're being asked to find a bus in a photo without a bus because it's a street scene, and every street scene has a bus in it.

I haven't read her book, yet, but her Twitter[2] is often full of amusing anecdotes like this.

[1] https://aiweirdness.com/

[2] https://twitter.com/JanelleCShane

Re:There is no evil like reCAPTCHA by Wowfunhappy on Monday August 05, 2019 @03:08PM (#20617501)
> People generally don't take pictures of rolling green hillsides. But they very often take pictures of rolling green hillsides with sheep on them. So if you ask the robot to draw a picture of rolling green hillsides, it will include sheep. Or, if you ask it to draw a picture of the savanna, it will want to include giraffes.

Don't humans do this too, though? If I asked someone to draw a picture of rolling green hills, they may well add sheep as an additional detail.

Re:There is no evil like reCAPTCHA by dwyerm on Tuesday August 06, 2019 @12:38PM (#20626814)
Well, personally, I had the "bliss" image from the Windows wallpaper collection in my head while I was writing this. But I'm cognizant that most of the photos of hillsides I took in Ireland had sheep in them.
Re:There is no evil like reCAPTCHA by Wowfunhappy on Tuesday August 06, 2019 @01:39PM (#20627519)
I wonder if that would still be true, though, if "bliss" wasn't a default Windows wallpaper. In other words, you're still referring to common pictures, you're just particularly biased to one in particular that you've seen a lot.

I haven't done the experiment, but I'd posit that if you walked up to a group of 8-year-old children, gave them crayons, and asked them to draw pictures of "rolling hills", a significant portion would add sheep, cows, flowers, or some other details—even though a majority of rolling hills in the world don't have any of these features.

Re:There is no evil like reCAPTCHA by braythwayt on Monday August 05, 2019 @01:27PM (#20616103)
Thank you, I ordered her book on the strength of your comment!
Re:There is no evil like reCAPTCHA by mindslight on Monday August 05, 2019 @01:06PM (#20615834)
I wonder if you ran into something I deliberately mislabeled as a bus.

Your goal shouldn't be to answer the question earnestly, but to confirm the machine's biases. Going with the flow is expedient, as well as giving Google less support.

Re:There is no evil like reCAPTCHA by ceejayoz on Monday August 05, 2019 @01:15PM (#20615961)
In this case, it was obvious what it wanted someone to do.

It gets more frustrating when it's less clear. Is "click the hills" with a picture of a mountain a mistake, or a trick? Should I click all the tiles that contain a bus, even if it's only one pixel, or should I only click the ones that mostly contain a bus? etc.