News for hackers. Stuff that matters.
Re:Algorithms for Massive Data Sets by maurits on Sunday June 05, 2011 @01:47PM (#2622455)
One can also have a look at the stanford course "Mining Massive Datasets". No video lectures (yet) but course information here:

http://www.stanford.edu/class/cs246/cs246-11-mmds/handouts.h...

The book here: http://infolab.stanford.edu/~ullman/mmds.html

Re:Algorithms for Massive Data Sets by DanielRibeiro on Sunday June 05, 2011 @07:17PM (#2623086)
Also posted and discussed here: http://news.ycombinator.com/item?id=1984449
Re:Algorithms for Massive Data Sets by ajays on Sunday June 05, 2011 @08:31PM (#2623241)
Dated: 15-May-2002 . Just sayin'. There's been a lot of work in the last decade on this subject.
Re:Algorithms for Massive Data Sets by mturmon on Monday June 06, 2011 @01:13AM (#2623768)
Also seemed like a high proportion of the curriculum in coding. I like coding, but...
Re:Algorithms for Massive Data Sets by PaulHoule on Sunday June 05, 2011 @08:49PM (#2623277)
yeah my first thought was like all this stuff is about ten years old
Re:Algorithms for Massive Data Sets by helwr on Sunday June 05, 2011 @09:22PM (#2623343)
I posted more recent stuff under the link below. Feel free to add whatever is missing.
Re:Algorithms for Massive Data Sets by grk on Sunday June 05, 2011 @03:53PM (#2622709)
https://massivedatasets.wordpress.com/ from a Danish Technical University course with the same name
Re:Algorithms for Massive Data Sets by cdavid on Monday June 06, 2011 @02:43AM (#2623928)
As mentioned by others, this list is old. The cited algorithms are certainly still good to know, but the meaning of massive is different now. Today, massive means:

  - too large to fit even in big iron (few people can afford them anyway)
  - low value: a lot of data are useless / too bad to be useful, so not taking into account all of them all the time is not too bad.
Nothing outside near linear or even sublinear algorithms really work in those cases. Singular Value Decomposition is a great example. Up to recently, it was mostly about about doing fast, accurate SVD for large matrices. There is a recent surge on approximate algorithms which see any data only once at most. This is useless for most "hard" engineering tasks, but for analysis of large graph data, you can most likely tolerate a few % of error in your biggest singular values to still get something useful.

The fun part is that things as simple as matrix multiplication become an interesting and potentially hard problem.

Re:Algorithms for Massive Data Sets by pyronicide on Sunday June 05, 2011 @01:34PM (#2622434)
Would anyone know if there's audio/video of these lectures? I keep seeing amazing classes like this and wishing that everyone could enjoy them instead of just the local students.
Re:Algorithms for Massive Data Sets by siculars on Sunday June 05, 2011 @10:02PM (#2623424)
Slides, notes and papers from Sergei Vassilvitskii's class on a similar topic, COMS 6998-12: Dealing with Massive Data, http://www.cs.columbia.edu/~coms699812/ .
Re:Algorithms for Massive Data Sets by akivabamberger on Sunday June 05, 2011 @10:51PM (#2623501)
Great class.
Re:Algorithms for Massive Data Sets by helwr on Sunday June 05, 2011 @12:31PM (#2622287)
Re:Algorithms for Massive Data Sets by chrisaycock on Monday June 06, 2011 @12:54AM (#2623731)
Also of potential interest is Stanford's "Workshop on Algorithms for Modern Massive Data Sets" (MMDS):

http://www.stanford.edu/group/mmds/