News for hackers. Stuff that matters.
Re:Stop Words as Social Signals (a result that goes against ... by conanite on Thursday April 29, 2010 @04:38PM (#1305952)
Amazing that [to, to, on, my, to, on, be, on, to, to ... etc] can reveal so much. One of the linked articles ( http://homepage.psy.utexas.edu/homepage/faculty/pennebaker/r... ) describes how the relative frequency of the use of "I" in communication is a powerful indicator of status (less "I" => higher status).
Re:Stop Words as Social Signals (a result that goes against ... by patio11 on Thursday April 29, 2010 @05:17PM (#1306092)
Stop word distributions are also sufficient for identifying gender in most English corpora with about 80% accuracy -- and you don't need much text, either.

[Edit to add linky: http://u.cs.biu.ac.il/~koppel/papers/male-female-text-final.... ]

Re:Stop Words as Social Signals (a result that goes against ... by conanite on Thursday April 29, 2010 @05:42PM (#1306168)
I wonder would James Chartrand have been found out ... http://news.ycombinator.com/item?id=994284 [Why James Chartrand Wears Women’s Underpants]
Re:Stop Words as Social Signals (a result that goes against ... by patio11 on Thursday April 29, 2010 @06:08PM (#1306242)
I put her four posts written right before the "reveal" post through the first gender guesser I found on Google, and they all came out female. That proves essentially nothing, granted, but this has been studied fairly extensively. If you want to do twenty minutes of work with automation you can grab everything she's ever posted on CopyBlogger and run it through your classifier of choice. Then, heck, run the guys on CopyBlogger against it and see if you peg them right, too.

Natural language processing remains my first love.