Re:Google Labs: Books Ngram Viewer
by jambo on Thursday December 16, 2010 @03:38PM
(#2013550)
I'm very happy to see Google offering the ngram counts for free download (http://ngrams.googlelabs.com/datasets), which I wasn't expecting, given their earlier web corpus data release on DVDs. Maybe we'll see an update on that front, too.
Re:Google Labs: Books Ngram Viewer
by jjclarkson on Thursday December 16, 2010 @06:16PM
(#2014314)
I think overuse of the word "cool" might finally be heading downward. And it's interesting to see the blips in the 70's and 80's of "groovy" and "rad" respectively.
Re:Google Labs: Books Ngram Viewer
by msbmsb on Thursday December 16, 2010 @06:56PM
(#2014438)
Country names/adjectives:
English,England,British,French,France,German,Germany
In most cases the adjectival form of a country tracks pretty closely to the nominal form (e.g. France vs French and others) except for the case of England vs English/British, the latter two spike from almost nothing around 1795. I can't think of a good explanation for why those two forms were so rare in comparison with "England" before 1795, anyone have an idea?
Re:Google Labs: Books Ngram Viewer
by goldins on Thursday December 16, 2010 @02:56PM
(#2013354)
An interesting thing I noticed is that the usage of the word "the" has decreased by about 1% in the last century (which I think is significant considering the data). I wonder what the reason for this is.
Re:Google Labs: Books Ngram Viewer
by nl on Thursday December 16, 2010 @06:38PM
(#2014389)
I love this. Here's the story of the world since 1750. The scientific revolution, followed by the industrial revolution, followed by the computer revolution, with the internet revolution just starting:
Re:Google Labs: Books Ngram Viewer
by rbancroft on Thursday December 16, 2010 @04:39PM
(#2013841)
Yes, that was a cool one.
murder: pretty cyclical and consistent
rape: massive spike in the 80s and 90's, and declining a bit
fraud: blip after WW2, then pretty stable up to around 1995
nazi: interesting trends there
oil: some more interesting trends, a large spike in the early 80's
Interesting that the trends for freedom and liberty differ quite significantly, although they have some of the same 'humps'. Liberty has an uptick after 2000, whereas freedom does not.
Re:Google Labs: Books Ngram Viewer
by igravious on Thursday December 16, 2010 @05:05PM
(#2013965)
And you didn't try War and Peace? I did. Which term occurs more often in the corpus do you reckon? Try going back to 1500. Are you surprised? How about trying Love and War for all you hippies out there. What does this all say about humanity?
Re:Google Labs: Books Ngram Viewer
by igravious on Thursday December 16, 2010 @04:59PM
(#2013934)
That's interesting, isn't it? I think this proportionality is related to a quirk of human perception. If you are shown briefly a set of objects the average person is able (at a glance) to quickly count those objects for a low value whose threshold is around six or seven. Thus when the number goes any higher the individual will respond that there were "less than ten" or "fewer than ten". Of course because humans have standardized on base 10 as there counting system then ten will get bumped up in any distribution but to predict that it would occur between six and seven (the number of man and divinity no less) would be difficult.
What about 11 to 20? Hmm, it (roughly) goes: twenty, twelve, fifteen, eleven, eighteen, fourteen, sixteen, thirteen, seventeen, nineteen! Just what I expected :)
http://ngrams.googlelabs.com/graph?content=fame,same&yea...
http://en.wikipedia.org/wiki/Long_s
Wall Street vs Silicon Valley: http://ngrams.googlelabs.com/graph?content=wall+street,silic...
Telephone, Internet: http://ngrams.googlelabs.com/graph?content=telephone,+intern...
Microsoft, Netscape, Yahoo, Google, Facebook: http://ngrams.googlelabs.com/graph?content=Microsoft,Netscap...
Great War, Hitler, Communist, September+11: http://ngrams.googlelabs.com/graph?content=Great+War,Hitler,...
terrorism,socialism,communism: http://ngrams.googlelabs.com/graph?content=terrorism%2Csocia...
This could be a better chart: http://en.wikipedia.org/wiki/File:GDP_growth_1923-2009.jpg
There might be some kind of relationship there, but I don't think it's the whole explanation.
http://ngrams.googlelabs.com/graph?content=cool%2Chip%2Cgroo...
In most cases the adjectival form of a country tracks pretty closely to the nominal form (e.g. France vs French and others) except for the case of England vs English/British, the latter two spike from almost nothing around 1795. I can't think of a good explanation for why those two forms were so rare in comparison with "England" before 1795, anyone have an idea?
http://ngrams.googlelabs.com/graph?content=English%2CEngland...
http://ngrams.googlelabs.com/graph?content=can%27t%2Ccouldn%... vs http://ngrams.googlelabs.com/graph?content=t%2Ccan%27t%2Ccou...
http://ngrams.googlelabs.com/graph?content=Colorless+green+i...
The correlation patterns and the year where the curve picks up are interesting. It would be illuminating to map the peaks.
inflammable, flammable: http://ngrams.googlelabs.com/graph?content=inflammable%2Cfla...
regardless, irregardless: http://ngrams.googlelabs.com/graph?content=inflammable%2Cfla...
http://ngrams.googlelabs.com/graph?content=science,industria...
Combine this with Google Sets ( from Labs as well http://labs.google.com/sets?hl=en&q1=immigration&q2=... ) so that I can feed a list generated by Sets into Ngrams.
Thanks! (And a pony too.)
murder: pretty cyclical and consistent rape: massive spike in the 80s and 90's, and declining a bit
fraud: blip after WW2, then pretty stable up to around 1995
nazi: interesting trends there
oil: some more interesting trends, a large spike in the early 80's
Interesting that the trends for freedom and liberty differ quite significantly, although they have some of the same 'humps'. Liberty has an uptick after 2000, whereas freedom does not.
http://ngrams.googlelabs.com/graph?content=star+wars,+galosh...
http://ngrams.googlelabs.com/graph?content=i+love+you&ye...
It's possible that's more to do with the distribution of books Google has scanned than anything.
Note the effects of the world wars.
http://ngrams.googlelabs.com/graph?content=quick+brown+fox,b...
Am I reading that correctly: People rarely talk about brown foxes without mentioning their speed, which is never slow?
More importantly: if I wrote and published a book about a slow brown fox, could I potentially do to foxes what Chomsky did to green ideas?
http://ngrams.googlelabs.com/graph?content=one%2Ctwo%2Cthree...
In order, except "ten" shows up between "six" and "seven".
What about 11 to 20? Hmm, it (roughly) goes: twenty, twelve, fifteen, eleven, eighteen, fourteen, sixteen, thirteen, seventeen, nineteen! Just what I expected :)
http://ngrams.googlelabs.com/graph?content=1%2C2%2C3%2Cone%2...
for a short period of time in the 80s and 90s, 1 was more popular than one, where from the 1700s through 1950s, 1 was half as popular as one ...
http://ngrams.googlelabs.com/graph?content=one%2Ctwo%2Cthree...