Re:Gender and verbs across 100K stories: a tidy analysis
by swf on Friday April 28, 2017 @09:07AM
(#14219034)
The author mentions in the second paragraph that the data comes from scraping Wikipedia articles' plot descriptions. So the plots might be old, but the descriptions (and language) were all written recently.
[ Parent
| on HN ]
Re:Gender and verbs across 100K stories: a tidy analysis
by ghaff on Friday April 28, 2017 @09:44AM
(#14219284)
Before drawing any strong conclusions, I'd probably want to do at least some validation against original sources, e.g. Project Gutenberg. You're talking about plot descriptions written by a mostly fairly narrow demographic. I'd be hesitant to use that to draw conclusions about the source material.
Re:Gender and verbs across 100K stories: a tidy analysis
by SerLava on Friday April 28, 2017 @09:33AM
(#14219195)
Hm. Wouldn't that have little bearing on the result? Can't really say "he poisons" when that wasn't the plot of the story.
Re:Gender and verbs across 100K stories: a tidy analysis
by Bartweiss on Friday April 28, 2017 @10:32AM
(#14219645)
It might have a large impact on the language, though. 'Empoison' used to be a verb, 'burgle' has largely been replaced with 'rob', and so on. I think this would tend to improve the data, though - 'empoison' and 'poison' ought to be grouped.
Re:Gender and verbs across 100K stories: a tidy analysis
by lmkg on Friday April 28, 2017 @09:40AM
(#14219244)
But that's the point. "She poisons" is more likely to be the plot of the story than "he poisons."
Re:Gender and verbs across 100K stories: a tidy analysis
by davrosthedalek on Friday April 28, 2017 @12:18PM
(#14220695)
There could be a bias in the summary writers too, in that they prefer "he murders" and "she poisons" for the same method of killing.