1) Compare your collected data series to each other to determine a "reliability" index for each data series.
2) Construct a series as a weighted average on this reliability index.
3) Iterate, using your new series to calculate the reliability index.
There are substantial issues with the above approach, having to do with sensitivity to particular kinds of signals. For a while, the Climate Audit folks got a lot of mileage over a data set that was put in "upside down" in one of the reconstructions. Rather than claiming "data error," the author defended it based on the idea that the above process would just give it a negative weighting!
Regardless, you should see why the above could easily be susceptible to issues. Further, the disagreement between these reconstructions and what our limited historical sources tell us about the MWP, etc., makes them further suspect.
This is a problem for the global warming model because it means that we don't know what the historical standard deviation for temperature is. So we can't say whether the last 3 decades warming is "within normal deviations" or "unprecedented."
I would just point out that scientific debate occurs through published papers and conference presentations, not programming message boards. I hope that you are publishing in those channels if you feel you have substantive contributions to this kind of research.
And happily, informal communication and message boards matter more than you would think!
Also, the published papers reporting these studies are all easily available. I highly advise reading them for yourself.
I don't have direct experience with climatology, but from what I understand it's somewhat similar: conferences like AGU are really important to climatologists for that reason.
Edit to acknowledge: obviously a lot of work gets done informally during conferences as well.
But it's in the service of publishable research, is it not? I don't think many scientists are going to say, "I'm changing my research program based on something I read on Hacker News yesterday." There's a bar for serious consideration.
edit: misspelling
I stand by the importance of published work in scientific discourse, but I apologize to schoper for taking a personal shot that was not called for.
http://en.wikipedia.org/wiki/Hockey_stick_controversy