Ask HN: List of open/public databases
A year or two ago somebody posted a list of open/free/accessible datasources for hackers to download and play around with. I thought this was a great resource, so I saved it, but heck if I can find it now.
Does anybody have such a list? Things like zip-codes for the US, locations of Starbucks stores, current weather forecasts, list of major newspapers, list of publicly-traded stocks, etc. I know there are tons of open/free databases waiting for us to mashup, just can't seem to find a list of them.
EDIT: The goal is a downloadable chunk of data to mashup, reformat, and use. That means CSV/XML/etc format and a public/anonymous FTP or something.
(
26 comments
| 64 points
| on HN
)
http://www.reddit.com/r/datasets http://www.reddit.com/r/opendata
http://delicious.com/sidmitra/datasets
Also, if you’re in the UK the government datasets might interest you: http://data.gov.uk/
US Govt data on the stimulus: http://www.recovery.gov/FAQ/Pages/DownloadCenter.aspx
Anybody from Google on? There has to be some shortcuts here somewhere.
It is fast and easy to use if you are already using EC2.
http://archive.ics.uci.edu/ml/datasets.html
http://data.worldbank.org/developers
The SRTM data is < 20 gigs compressed, and I downloaded it from some source, can't find the link now. It was a SLOWWWWWW download, so took many days. Reminded me of my old 2400 baud modem.
the NED dataset is just shy of 500 gigs. We shipped a drive off to the USGS and they populated it and shipped it back. The 2 month wait sucked, but it was the only way to get it without paying a thousand bucks from a private company.
I am happy to share either the SRTM or the NED dataset we have, but sharing it is pretty much limited to shipping hard drives around :(
They also got a API ... see the wiki.
Examples:
zip codes in the US: http://www.factual.com/t/MwwkkU/US_Zip_Codes
stock symbols: http://www.factual.com/t/jyqdWC/market_symbols
I work at Factual, so if you have feature requests/comments/complaints please let me know! I'm leo at factual dot com
Datasets about some Canadian cities:
http://www.toronto.ca/open/datasets/web-map-services/
http://data.edmonton.ca/
http://data.vancouver.ca/
http://musicbrainz.org/doc/MusicBrainz_Database