News for hackers. Stuff that matters.
Re:Mapping Racist Tweets in Response to President Obama's Re... by nhebb on Friday November 09, 2012 @09:03AM (#4762794)
The problem I have with this is that it is needlessly stirring racial divides. 395 tweets out of ~120 million voters? Come on, do something positive for our country like mapping out the tweets of people still needing help from Sandy.
Re:Mapping Racist Tweets in Response to President Obama's Re... by glesica on Friday November 09, 2012 @10:21AM (#4763157)
I have a huge problem with people submitting bug reports because it needlessly creates the perception that the software is buggy.

Pointing out racism has nothing to do with "stirring racial divides". This appears to be a reasonably sophisticated analysis, the methodology was clearly explained. It certainly, at least, appears they didn't just make up a bunch of numbers.

If you disagree, then find data and make your case.

Re:Mapping Racist Tweets in Response to President Obama's Re... by cobrausn on Friday November 09, 2012 @10:41AM (#4763266)
He did make his case - 395 racist tweets out of 120 million voters is practically background noise. You should expect all manner of extreme behavior on a sample size that large.
Re:Mapping Racist Tweets in Response to President Obama's Re... by Anechoic on Friday November 09, 2012 @11:15AM (#4763433)
Again, that 395 number is not the total number of tweets, it's the number of tweets that included geolocation data. That 395 was likely a subset of the total number of racist tweets.
Re:Mapping Racist Tweets in Response to President Obama's Re... by cobrausn on Friday November 09, 2012 @11:30AM (#4763502)
And if it were 1,000? 5,000? 25,000? You're still talking epsilon-level percentages here.
Re:Mapping Racist Tweets in Response to President Obama's Re... by mistercow on Friday November 09, 2012 @02:45PM (#4764426)
"Epsilon-level percentages" isn't really a useful concept. As a sample size grows, phenomena become significant at smaller percentages. The set of all tweets is gigantic, so we can still make significant observations based on a "small" subset.

The point of this article is not to say "look at how many racists there are on Twitter." The point is to say "Let's look at the racist people on Twitter. What is the geographical distribution?"

395 geotagged tweets is absolutely enough to start making some interesting observations. Those observations can only be about relatively broad regions at that sample size, but they are interesting nonetheless.

Re:Mapping Racist Tweets in Response to President Obama's Re... by jdunck on Friday November 09, 2012 @11:54AM (#4763612)
In some previous twitter work, I've seen geo-located tweets at about 2-3% of all tweets (assuming no bias), so charitably 19750 racist tweets here.

Which is to say, I agree with you.

Re:Mapping Racist Tweets in Response to President Obama's Re... by glesica on Friday November 09, 2012 @10:45PM (#4765851)
The sample was from a subset (geolocated tweets) and involved only a very specific set of keywords. In other words, this was not an exercise to see how many racist tweets there are. It was an exercise to see where the racist tweets generally come from. All that was needed here was a relatively small random sample. So the analysis, at least in terms of the sample size itself, is almost certainly valid. You may have misunderstood the point of the post...
Re:Mapping Racist Tweets in Response to President Obama's Re... by Claudus on Friday November 09, 2012 @10:11AM (#4763099)
I have the exact same problem, I'm sure that there are many racists in our country, but this graphic is pretty garbage.

1) There are about 35 to 40 million Americans on Twitter, (15% of the 78.1% of online Americans).

2) Does the percentage of twitter users per state factor into this, it seems not.

3) "A score of 1.0 indicates that a state has relatively the same number of hate speech tweets as its total number of tweets. Scores above 1.0 indicate that hate speech is more prevalent than all tweets". This makes no sense to me, unless a single tweet somehow counts multiple times, e.g. "obama monkey monkey monkey monkey". There are more racists tweets than tweets? How is that possible?

4) Is every instance of "monkey" racist? Is it racist to call George Bush a monkey?

5) Was context applied, or is simply using certain word combinations racist? Go to twitter and do the search yourself, many of the tweets are responses to racist tweets or not racist at all.

I'm sure there are many racists in America, but this graphic is painting a very misleading picture.

Re:Mapping Racist Tweets in Response to President Obama's Re... by omaranto on Friday November 09, 2012 @11:24AM (#4763477)
The reason the quote in 3) makes no sense is that it's wrong. :) The article gives a correct explanation in a footnote:

    The formula for this location quotient is

    (# of Hate Tweets in State / # of Hate Tweets in USA) 
    ------------------------------------------------------------
    (# of ALL Tweets in State / # of ALL Tweets in USA)
Re:Mapping Racist Tweets in Response to President Obama's Re... by jessedhillon on Friday November 09, 2012 @11:23AM (#4763475)
Why do you respond when you can't even be bothered to read TFA? The criteria used to find the tweets was very clearly described in footnote 1.

Regarding your #4: just shut up.

Re:Mapping Racist Tweets in Response to President Obama's Re... by 1123581321 on Friday November 09, 2012 @11:46AM (#4763574)
Would you please edit your #4 response to be more informative and thoughtful, or remove it? It is currently incendiary and not helpful, and as someone who has exchanged emails with you privately in the past (financial industry software opportunities) I know you can write something better here.
Re:Mapping Racist Tweets in Response to President Obama's Re... by jessedhillon on Friday November 09, 2012 @03:23PM (#4764588)
Yeah, it's not the most professional way to put things. The question itself is, frankly, ridiculous -- I only see two ways to parse it:

1) This person is asking for a philosophical discussion on the nature of semantics. Given the incendiary context here, if that is a sincere desire, I consider that to be sophistry.

2) This person is impossibly naive about society, the world and the state of current affairs. In this case they should be listening more and speaking less.

At any rate, thank you for your comments and your faith in my abilities. I genuinely appreciate your not flaming me, however deserved, and expressing your concern calmly instead.

However, although rash and inarticulate, stating my feelings the way I did communicates an emotional punch that my outline above doesn't. And although I do sometimes delete hastily-written comments, in this case I will leave my name it. I don't care much for people who can't see the forest for the trees on this issue. Arguing the semantics of racial epithets is, frankly, bullshit.

Re:Mapping Racist Tweets in Response to President Obama's Re... by dobro on Saturday November 10, 2012 @07:00AM (#4766507)
>Regarding your #4: just shut up.

The problem with racism is not that it targets people of color. It's that it targets them in order to treat them bad. The KKK wouldn't be any better if they targeted people blindly. So, I take offense with your behavior here: being rude to everybody and anybody is just as bad as being racist in a tweet.

The arguments put forth in the parent comments seem perfectly valid. The sample is in the region of statistical noise, and as such gives very little information about the matter.

Also, I believe that Twitter as a sampling space is flawed. E.g places like Mississippi and Alabama might have far more rampant racism than California, but be underrepresented in the category of "people with tweeter accounts" because of poverty rates.

Re:Mapping Racist Tweets in Response to President Obama's Re... by tankbot on Friday November 09, 2012 @11:37AM (#4763531)
RE: #4

No, it's not racist. It's just ignorant. Everyone knows George Bush (along with all humans) is not a monkey, but an ape. Specifically an African ape. Knowing this makes racism a pretty humorous topic.

Re:Mapping Racist Tweets in Response to President Obama's Re... by king_jester on Friday November 09, 2012 @09:58AM (#4763028)
> The problem I have with this is that it is needlessly stirring racial divides.

The divides exist, pointing that out doesn't make things worse and helps people be more aware of racism in society.

Re:Mapping Racist Tweets in Response to President Obama's Re... by danso on Friday November 09, 2012 @10:59AM (#4763359)
The divides exist, but this map does virtually nothing to shed illumination on the matter. I think everyone here can figure out why the methodology and sampling size would lead to inaccurate results...and at the same time, I think everyone would also agree that this sampling would vastly undercount the actual amount of racism among our citizenry (as frequent Twitter users have a much different demographic than the voting demographic).

Is there a way to see what actual tweets were classified as racist? Or is it just ones that used words commonly accepted to be hate speech? If the latter, then my main issue with this is that this is nothing more than social porn...a way to set the bar for racism so blatantly high that we forget that the most damaging, pernicious kinds of racism are not going to be expressed through explicit language by a few scattered morons.

Re:Mapping Racist Tweets in Response to President Obama's Re... by no_more_death on Friday November 09, 2012 @11:01AM (#4763368)
One thing to take into account: A lot of racists probably are technologically backward and don't use Twitter.

Another thing: I'm sure that a lot of racist tweets were NOT detected by their methodology.

Still, it's true that racism is mostly in the past, particularly in conservative circles. I have met a couple of older people who were racist. They wouldn't use the n-word, but they would speak in somewhat stiff terms of "electing someone who is Anglo-Saxon" or "electing someone who is like us." The couple I mean were previously members of the John Byrd society, so they were from THAT stream of people.

I would observe the widespread acclaim that Herman Cain received from conservative media as a good indication that racism is a thing of the past for conservatives. Also when you consider that Obama's party, the Democratic Party, was once a southern phenomenon with a vocal racist branch that even split out a "Dixiecrat" party, it's pretty clear we've come a long way.

Re:Mapping Racist Tweets in Response to President Obama's Re... by josephlord on Friday November 09, 2012 @11:46AM (#4763573)
"Still, it's true that racism is mostly in the past,..."

I hope you are right but that is bold prediction about the future path of humanity.

Re:Mapping Racist Tweets in Response to President Obama's Re... by Anechoic on Friday November 09, 2012 @09:46AM (#4762977)
395 tweets out of

It's 395 geocoded tweets, not 395 tweets total across Twitter.

Re:Mapping Racist Tweets in Response to President Obama's Re... by greedo on Friday November 09, 2012 @10:12AM (#4763100)
And no metrics on how many of those tweets were from the same people.
Re:Mapping Racist Tweets in Response to President Obama's Re... by jfaucett on Friday November 09, 2012 @10:22AM (#4763164)
I completely agree, these people are idiots. Why waste time trying doing something so non-constructive to society?