Re:Prophet: forecasting at scale
by anton_tarasenko on Monday February 27, 2017 @05:53AM
(#13743332)
BigQuery also has the public dataset of Wikipedia page views. Handy for quick SQL and sampling.
An intro by Felipe Hoffa (Google): https://www.reddit.com/r/bigquery/comments/3dg9le/analyzing_...
The Wikimedia foundation provides an public page view API for most Wikimedia projects:
Thanks, that's a good resource. I'm surprised though. It seems that Top-1000 articles by monthly views are 90% about celebrities and movies. I think tags or categories would be most useful.
https://wikimedia.org/api/rest_v1/metrics/pageviews/top/en.w...
Re:Prophet: forecasting at scale
by JoelSanchez on Monday February 27, 2017 @05:53AM
(#13743330)
https://tools.wmflabs.org/pageviews/?project=en.wikipedia.or...
What's up with Java? (Set "logarithmic scale" to improve the visualization)
the wiki page is about Java the country, not the programming language. Haven't found any relevant news around that time though.
Re:Prophet: forecasting at scale
by JoelSanchez on Monday February 27, 2017 @09:14AM
(#13744288)
Indeed, that's why I used "Java (programming language)".
Cool! I wonder what spiked the views for artificial intelligence on 10/11/2016?
https://tools.wmflabs.org/pageviews/?project=en.wikipedia.or...
I think that spike peaks on October 12, which is when this was released: https://obamawhitehouse.archives.gov/blog/2016/10/12/adminis...
The wikipediatrend R package relies on http://stats.grok.se/, which in turn relies on https://dumps.wikimedia.org/other/pagecounts-raw/ which has been deprecated.
The new dump is located at https://dumps.wikimedia.org/other/pageviews/
Data is available in hourly intervals.
* pageviews-20170227-050000
[edit] There is a wikipedia-hosted OSS viewer for these logs, e.g. Swedish crime stats:https://tools.wmflabs.org/pageviews/?project=en.wikipedia.or...