As a gateway to further reading (covering many of the interesting facts people are pointing out here), I enjoyed http://en.wikipedia.org/wiki/Curse_of_dimensionality