News for hackers. Stuff that matters.
Re:Looking At The World Through Twitter Data by TravisPe on Tuesday May 08, 2012 @10:50PM (#3946881)
A friend and I started playing around with twitter data back in early 2010. We currently have something close to over 587 million tweets collected (We stopped collecting earlier this year). We only pulled English tweets and those that described what someone was feeling (Im, I am, I feel, I am feeling, etc. along with the negatives I don't feel, I do not feel, etc).

We were able to see some interesting events happen during the time though. This is a graph of the anxiety levels of twitter on March 11th, the bottom axis is the hour of the day EST. The earthquake hit Japan @ 1:46 EST.

http://i.imgur.com/BeBwa.jpg

There is a strange dip around noon that we are unsure of how to account for as our servers did not report any failures.

It was a fun project to play around with.

Re:Looking At The World Through Twitter Data by Anon84 on Wednesday May 09, 2012 @10:15AM (#3948640)
That type of daily behavior is common in human activities. It matches nicely with typical daily activities like waking up, having lunch, etc... See http://www.bgoncalves.com/component/jdownloads/finish/3/17.h... for an example in web page traffic, http://www.barabasilab.com/pubs/CCNR-ALB_Publications/200805... for cell phone traffic, etc...
Re:Looking At The World Through Twitter Data by cpeterso on Wednesday May 09, 2012 @12:22AM (#3947096)
> There is a strange dip around noon that we are unsure of how to account for as our servers did not report any failures.

Maybe people are away from their computer at lunch.

What do the blue and green line colors indicate? It would also be interesting to track emoticons. :)

Re:Looking At The World Through Twitter Data by TravisPe on Wednesday May 09, 2012 @02:41AM (#3947335)
The green line represents the number of tweets that were marked as being anxious and the blue lines represents tweets marked as calm.

You can see that after the tsunami hit there was a general spike in the overall traffic, but a much larger spike for tweets where the user described being anxious.

We also analyzed the tweets for emotions flagging each to either be "happy" or "sad". Don't have the data able to be displayed in any consumable format at the moment though.

These are some logs for the day (totals)

                   Calm   Anxious Happy   Sad
  2011-03-08       2034   8730    77032   94119
  2011-03-09       1349   5129    47708   59406
  2011-03-10       1614   6020    51623   72214
  2011-03-11       4126   20427   87763   126688
  2011-03-12       3251   13009   104434  136389
We had 96 adjectives we used to filter for anxiety and 3242 adjectives we used for emotions (happy/sad).