Re:English Letter Frequency Counts: Mayzner Revisited
by ComputerGuru on Saturday January 05, 2013 @01:49PM
(#5013544)
I would think tweets would be skewed, no? Slang, memes, shrtnd txt 2 avoid char lmts, http://urls/, amongst others?
[ Parent
| on HN ]
Re:English Letter Frequency Counts: Mayzner Revisited
by talaketu on Sunday January 06, 2013 @02:46PM
(#5017447)
No corpus is immune from comparison, and each will have statistical parameters that reflect it's original selection criteria.
Perhaps Mayzner's corpus, apparently based on a sample from literature, exhibits a bias away from the abbreviated forms widely used in written communication today.
So, if you wanted to tune your text prediction software for your phone...