Also SEO provides at least something for the long tail. My belief is that the algorithm is able to predict what looks like “content” to a broad consumer base. Then the fatter the tail gets the more they manually tweak the results (like editors doing publishing).