News for hackers. Stuff that matters.

Ask HN: big data sets to play around with?

I want to gain some experience programming some machine learning techniques with large data sets. Something for fun like trying to predict the stock market, etc.

Does anyone know of some relatively accessible sets of large data that one could get a hold of for free? Anything like past financial history, to tweets or facebook posts, whatever.

Cheers

( 5 comments | 3 points | on HN )
Re:Ask HN: big data sets to play around with? by byoung2 on Monday June 25, 2012 @05:01PM (#4158725)
http://aws.amazon.com/publicdatasets/ is a good place to start
Re:Ask HN: big data sets to play around with? by mindcrime on Monday June 25, 2012 @05:18PM (#4158792)
Just go to this Quora question, you'll find tons of answers to this question:

http://www.quora.com/Data/Where-can-I-get-large-datasets-ope...

And don't forget http://commoncrawl.org

Re:Ask HN: big data sets to play around with? by fendrak on Monday June 25, 2012 @05:19PM (#4158803)
Infochimps hosts lots of free data sets:

http://www.infochimps.com/search?view=list&price_categor...

Re:Ask HN: big data sets to play around with? by ch00ey on Tuesday June 26, 2012 @10:46PM (#4165260)
http://buzzdata.com/content/

They have TONS of free open data sets that you can play aound with.

Re:Ask HN: big data sets to play around with? by Pyrodogg on Wednesday June 27, 2012 @01:00AM (#4165600)
Why not try joining in a competition while you're learning?

http://www.kaggle.com/