Re:Data sets released by Google
by supo on Friday September 27, 2013 @06:39AM
(#6456290)
Nice, thanks! I wish there was a cleaned up repository of datasets like these, in a unified format, directly accessible to a public MapReduce engine like Elastic at AWS.
Re:Data sets released by Google
by X4 on Friday September 27, 2013 @01:40PM
(#6458316)
BitTorrent Please!
Why does it cost so much? They grabbed our data for free and they have enough free Bandwidth. Let's assume they are greedy, then they could at least offer it through BitTorrent. DVD's for that amount of data is ridiculous. I don't even have a DVD-Reader…
Can't afford buying all that + shipping to Europe, but would like to play with the Data for my NLP Project.
Re:Data sets released by Google
by skun on Saturday September 28, 2013 @08:53AM
(#6461683)
I agree ! I too can't afford it but would really love to play around with that data because i'm just beginning to learn about NLP and stuff. I too feel that shouldn't have been priced and not in a DVD!
Re:Data sets released by Google
by ChikkaChiChi on Friday September 27, 2013 @11:55AM
(#6457619)
Fantastic links throughout this thread.
When playing with new programming languages instead of a 'todo' list I always end up building an XKCD password generator. Interestingly enough, I've never found a frequency/comprehension list worth using to populate it for public consumption.
http://datahub.io/
http://blog.bigml.com/2013/02/28/data-data-data-thousands-of...
http://tm.durusau.net/?p=39312
http://dvn.iq.harvard.edu/dvn/
_____________
this subreddit seems like a decent place to ask questions
http://www.reddit.com/r/datasets
http://commondatastorage.googleapis.com/books/icdar2007/READ...
http://datahub.io/
http://blog.bigml.com/2013/02/28/data-data-data-thousands-of...
http://iatiregistry.org/
http://open.undp.org/
http://data.worldbank.org/
https://explore.data.gov/catalog/raw/
http://www.data.gov/opendatasites
http://data.gov.be/datasets
http://opencorporates.com/
http://glasspockets.org/work/reportingcommitment/api.html
http://thedata.harvard.edu/dvn/
http://www.reddit.com/r/datasets
http://archive.ics.uci.edu/ml/
http://cleandatahub.org/
http://datacatalogs.org/
http://archive.org/details/oxford-2005-facebook-matrix
Can't afford buying all that + shipping to Europe, but would like to play with the Data for my NLP Project.
http://archive.ics.uci.edu/ml/
Remember the days when people used to make links on the web because they weren't greedy with their pagerank?
At least Google left us some machine learning data sets after they took all the links. You just can't find them because nobody links to them.
When playing with new programming languages instead of a 'todo' list I always end up building an XKCD password generator. Interestingly enough, I've never found a frequency/comprehension list worth using to populate it for public consumption.
https://code.google.com/p/word2vec/#Pre-trained_entity_vecto...