Kaggle => http://www.kaggle.com/
List of data sets => http://www.datawrangling.com/some-datasets-available-on-the-...
Another list of data sets => http://blog.mortardata.com/post/67652898761/6-dataset-lists-...
List of data sets on Quora => http://www.quora.com/Where-can-I-find-large-datasets-open-to...
Sub-reddit for data sets => http://www.reddit.com/r/datasets
http://jacquesmattheij.com/Free+Public+Data+Sets
If you know of any others, please post them.