See the Wikipedia article
http://en.wikipedia.org/wiki/Correlation
and especially its well done graphs
http://en.wikipedia.org/wiki/File:Correlation_examples.png
http://en.wikipedia.org/wiki/File:Anscombe.svg
(one based on a famous article by a statistician) for what correlation coefficients alone do and do not say about relationships among data points.
However, is there a better/more respected metric for comparing how two datasets are related? Mutual Information perhaps?
I mean, r^2 isn't all that misleading if your relation really is linear. R^2 plus a graph of the regression would be sufficient. Just taking a look at the residuals of the Anscombe sets easily shows that linear fitting (thus r^2) is inappropriate for sets 2-4.
(btw: if you fit the second Anscombe data set with a 2nd order polynomial, r^2 = 1. Of course, it's pretty clear that there's hardly any error in that set.)