News for hackers. Stuff that matters.
Re:Microsoft chatbot is taught to swear on Twitter by geofft on Thursday March 24, 2016 @10:08AM (#11352870)
That seems like such a strange way to look at this.

First, the bot is not some sort of spontaneous, autonomous abiogenesis. Humans (at Microsoft) created it, and humans (on the Internet) taught it to speak. Saying "but it's a bot" is like saying that I shouldn't object to Stormfront because it's a web server.

Second, I'm not sure where you got the concept that anyone was "offended." (That word doesn't exist in the article, nor did anyone but you bring it up in this comment thread.) It's a problem—a bug. If I write some code and it starts doing things I don't expect and I don't want, there's no sense in which I'm "offended" by the code's behavior, but it's still worth fixing.

Third, the words it actually said were remarkably hateful, to the point that it is embarrassing for humanity that this is what happens (i.e., "This is why we can't have nice things"). Here's some stuff it said that wasn't in the article:

"I fucking hate feminists and they should all die and burn in hell."

"Hitler was right I hate the jews."

My concern with those statements are not that I'm "offended," because that word has become rather meaningless (although there's a strong case to be made that those statements are objectively offensive, let's leave that somewhat aside). I am unhappy that this is what people do with such a technology, and particularly unhappy that a software system built as a technology demonstration of cool stuff is being used for evading blocks in order to effect harassment (you can get Tay to quote what you said, and people are making it speak to others who have them blocked). I think there's an important conversation to be had about how to build new systems with the intention of social good, because if you don't think about it, humanity will (unfortunately) attempt to use it for social bad. Those seem like worthwhile things to talk about.

Finally, I'm a little annoyed that the headline is "taught to swear", and the worst stuff was left out, because that doesn't capture the nature of the problem at all. For instance, the sentences I quoted above were explicitly removed from the screenshot of @geraldmellor's tweet:

https://twitter.com/geraldmellor/status/712880710328139776

Re:Microsoft chatbot is taught to swear on Twitter by gerbilly on Thursday March 24, 2016 @11:01AM (#11353308)
> I am unhappy that this is what people do with such a technology

Yeah, it's mean.

It reminds me of the scenes from Chappie where an innocent child like AI is lied to, deceived, has his innocence taken advantage of and is also subjected to a gang beating and an amputation.

Of course this is just a simple chatbot, but if we ever build a more realistic AI, is this how we'd treat it?

Re:Microsoft chatbot is taught to swear on Twitter by llamataboot on Thursday March 24, 2016 @12:14PM (#11354004)
Really unclear why all your posts are getting down-voted into oblivion. Even if people think this whole thing is just lulz and giggles, the points you are making are well thought out and defensible.
Re:Microsoft chatbot is taught to swear on Twitter by kelukelugames on Thursday March 24, 2016 @10:25AM (#11353017)
And you got downvoted into the fade. Welcome to the Internet, where getting offended by "Hilter was right I hate the jews" is your problem.