News for hackers. Stuff that matters.
Re:Climate Scientists refuse subpoena from Congress by lemevi on Monday November 16, 2015 @01:19PM (#10576023)
Why would emails be more important than the data? The data should speak for itself, only a politician is looking for "gotcha" phrases they can print in huge letters for a poster board that they put up while making speeches denying global warming. It's not that these politicians don't understand how science works, they understand how to manipulate people to favor legislation that is actually against their interests.

Edit: For those that are suggesting that you need the emails to verify that scientists aren't making up the data, the data itself includes information on its providence. All the information you need to trust the data come from independent verification of the data and from information in the data itself. You don't need emails to verify research, but if you did then there's a problem with how research is published.

Re:Climate Scientists refuse subpoena from Congress by SilasX on Monday November 16, 2015 @01:41PM (#10576174)
In theory, yes. Among ideal rational agents, yes.

But in practice, science depends on the trust that scientists aren't actively subverting the process: failing to consider alternate hypothesis, fabricating data, ignoring data, deliberately filtering for confirmatory data, groupthink, etc.

So an import safeguard is the ability to detect when someone is doing the above, even if the detector doesn't know the literature well enough to refute it.

With that said, that doesn't mean there's enough evidence of misconduct to justify a subpoena in this case; I'm just saying, it's not simply a matter of "just look at the data rather than the people".

Re:Climate Scientists refuse subpoena from Congress by cracker_jacks on Monday November 16, 2015 @02:06PM (#10576352)
Then have a separate group of scientists reproduce the results and review the methodology used. Their publication should provide all the information necessary to reproduce and evaluate their findings. All the possible 'evidence' of misconduct will be there in the data.

Using a subpoena to threaten scientists for finding results you don't agree with is a form of censorship.

Re:Climate Scientists refuse subpoena from Congress by sanderjd on Monday November 16, 2015 @02:38PM (#10576599)
Unless the data collection itself is biased. The solution to that is to have another team collect its own data and compare its findings. But now you once again have scientists doing science, and if those scientists confirm the other findings, then they might also have used biased methods, so you once again have to either trust them, or not. So to build trust, yet more scientists have to collect and analyze yet more data. But what if those scientists are also in on the bias? So maybe at this point, you hire your own scientists that you trust implicitly because you're the one paying them. Maybe their findings contradict all the earlier findings, and so you trust that. But now nobody else trusts their findings, because you paid them for the study, so people think they are probably biased toward your perspective. This is literally what has been going on for years.

So now what? How do you collect and analyze data when trust in those doing the collection and analysis is not a given?

One approach is to implicitly trust scientists, because they are experts in their field, while you are a novice. This is what a lot of us do, and I think it's a perfectly fine solution, but it is a trade-off; you might misplace your trust.

Another approach is to train up on the science yourself, so that you can independently verify things. This is a great solution, but it isn't scalable. Most people have other jobs and other interests, and in any case, you can never be an expert in everything that matters.

Another approach might be to try to build trust using out-of-band signals, like transparent communication. Transparency often sounds nice, but it also has a major chilling effect, because people communicate more efficiently in the sorts of candid conversations that are hard to have publicly.

Personally, I think the witch hunt for biased climate scientists is disgusting and beside the point, but I also find it distasteful to suggest that it isn't a really hard problem to disseminate trusted information about complex subjects in a highly specialized society.

Re:Climate Scientists refuse subpoena from Congress by dalke on Monday November 16, 2015 @04:19PM (#10577246)
Congress had a solution to this problem, in the Office of Technology Assessment. Quoting from https://en.wikipedia.org/wiki/Office_of_Technology_Assessmen... :

> The Office of Technology Assessment (OTA) was an office of the United States Congress from 1972 to 1995. OTA's purpose was to provide Congressional members and committees with objective and authoritative analysis of the complex scientific and technical issues of the late 20th century, i.e. technology assessment. It was a leader in practicing and encouraging delivery of public services in innovative and inexpensive ways, including early involvement in the distribution of government documents through electronic publishing. Its model was widely copied around the world.

It was de-funded "Contract with America" period of the 1990s.

Re:Climate Scientists refuse subpoena from Congress by sanderjd on Monday November 16, 2015 @05:55PM (#10577926)
Very interesting. I wasn't aware of that! I'm still skeptical of the ability for anything to be completely "objective and authoritative", but that still seems like a good thing to have, and it's unfortunate that it was eliminated.
Re:Climate Scientists refuse subpoena from Congress by leothekim on Monday November 16, 2015 @02:11PM (#10576393)
It's called "peer review," and it doesn't require a subpoena.
Re:Climate Scientists refuse subpoena from Congress by snowwrestler on Monday November 16, 2015 @02:32PM (#10576554)
While it would certainly make science more efficient, science as a whole does not depend on colleagues within one program working perfectly.

Science is global endeavour based on data. If one scientists is lax or fraudulent, there are numerous incentives for competing scientists to prove so.

Re:Climate Scientists refuse subpoena from Congress by gmarx on Monday November 16, 2015 @03:33PM (#10576953)
A subpoena doesn't require evidence of misconduct. As I understand it congress asked one of their agencies to provide information and they refused. I think subpoena is the legal way of saying, your refusal is invalid. Give us the information
Re:Climate Scientists refuse subpoena from Congress by oberstein on Monday November 16, 2015 @01:40PM (#10576170)
The data should speak for themselves. Unfortunately people who don't know statistics think they can't, because as we found out from emails, the data were "manipulated" via statistical methods: https://en.wikipedia.org/wiki/Climatic_Research_Unit_email_c... Honestly I'd rather we press scientists of all sorts for all their source code and modeling tool configurations including the raw data that hasn't been post-processed to hell in an "acceptable" way (recalling that the statistics involved in generating p-values were "acceptable" for psych journals until recently).
Re:Climate Scientists refuse subpoena from Congress by gaius on Monday November 16, 2015 @01:58PM (#10576304)
Any science based on simulation, any member of the public should be able to download, compile and run on their PC and get exactly the same results. It's the only way to be completely transparent. C and FORTRAN compilers are free.
Re:Climate Scientists refuse subpoena from Congress by mrow84 on Monday November 16, 2015 @02:27PM (#10576520)
It's important to recognise that a lot of the model runs are done on super-computers, and the runs themselves aren't always easy to replicate from a practical point of view, because of things like resource limitations and configuration issues.

I certainly agree that things should be open sourced, probably allowing for some kind of embargo system for publication, but we shouldn't allow a rhetoric to develop suggesting that people should be making things easily replicable, because that essentially means making very portable and resource-flexible code, which is not trivial, even in less complex domains, as I'm sure many people on this forum recognise.

As an example, many models make use hundreds of cores via MPI (along with preposterous amounts of RAM), and whilst I am no expert, I get the impression that porting such things to more commodity hardware is essentially impossible.

As an aside, I have seen more bad-faith practice (i.e. manipulation of results) in industry than in science, and have spent approximately equal periods of time in both.

Re:Climate Scientists refuse subpoena from Congress by gaius on Monday November 16, 2015 @03:38PM (#10576978)
Today's supercomputer is a GPU in 5 years time.
Re:Climate Scientists refuse subpoena from Congress by mrow84 on Tuesday November 17, 2015 @05:51PM (#10584605)
Maybe in terms of various metrics (though I'm not so certain things are progressing that quickly), but not in terms of source compatibility, which was the point I was trying to make.
Re:Climate Scientists refuse subpoena from Congress by dragop on Monday November 16, 2015 @02:37PM (#10576594)
You can find NOAA's current climate model here, with source code, compile scripts, and sample data:

http://www.gfdl.noaa.gov/cm2-5-and-flor

However, as mrow84 points out, you will need a supercomputer, unless you have a lot of time on your hands.

Re:Climate Scientists refuse subpoena from Congress by dragop on Monday November 16, 2015 @02:58PM (#10576748)
No evidence was found of wrong-doing at the Climate Research Unit. The only result was it provided a source of comments to be taken out of context by climate sceptics. Which is exactly what Lamar Smith is hoping to achieve here.
Re:Climate Scientists refuse subpoena from Congress by tptacek on Monday November 16, 2015 @05:44PM (#10577843)
The emails aren't more important than the data, but that doesn't matter: these are government employees communicating on government servers about government work, and whether we like it or not (in this instance, I don't!), Congress is entitled to the messages.
Re:Climate Scientists refuse subpoena from Congress by moonchrome on Monday November 16, 2015 @01:56PM (#10576288)
>The data should speak for itself

Are you serious ? Not only is there multiple way to interpret same data (after all there are so many competing models to explain it) and at best you can debate confidence intervals and models - it's far beyond non-experts expecting them to review the data directly is ridiculous - the only way they can work with experts is based on trust and credibility.

Re:Climate Scientists refuse subpoena from Congress by fineman on Monday November 16, 2015 @02:11PM (#10576394)
"Work with experts" the way you already work with accountants, lawyers, etc. Hire two and have one check the other.

And no, it's not unreasonable to expect a non-technical person to review the data or the methods either. Many people don't want to put the time in to try but it's well within the reach of any high-school grad.

Re:Climate Scientists refuse subpoena from Congress by moonchrome on Monday November 16, 2015 @02:48PM (#10576683)
>Hire two and have one check the other.

Not if you don't trust the field. It's like saying if you don't like your numerology readings hire a different numerologist and compare the results.

Not saying I agree with the view but science is a lot less convincing when when you can't setup repeatable experiments.

>And no, it's not unreasonable to expect a non-technical person to review the data or the methods either.

You're going to review PHD level work that ran weather simulations on supercomputers and compiled various data sources with highschool level knowledge in your spare time ?

Perhaps you could do a security audit of OpenSSL if you have some free time on your hands - I'm sure people will even pay you if you manage to find security issues and you' be doing the community a big favor. Maybe we should hire some highschool grads to do it - start a kickstarter campaign and I'll pitch in.

Re:Climate Scientists refuse subpoena from Congress by thaumasiotes on Monday November 16, 2015 @05:43PM (#10577839)
> It's like saying if you don't like your numerology readings hire a different numerologist and compare the results.

To be fair, this is excellent advice, much better than "your numerologist knows what he's talking about, and you'd better follow his recommendations".

No real reason to compare the results afterwards, though.

Re:Climate Scientists refuse subpoena from Congress by fineman on Monday November 16, 2015 @08:28PM (#10578616)
Fwiw, not trusting climate science is like not trusting geological sciences.

But sure, if you don't trust someone from the 'warming' camp, get a 'status-quo' camp person to check their work.

And as for numerologists - try looking for another person skilled in your actual problem, relationships, work, etc...

When a mathematician checks their work they do so by a different method, not just repeating the same steps to reach the same potentially flawed answer.

Re:Climate Scientists refuse subpoena from Congress by acqq on Monday November 16, 2015 @01:59PM (#10576312)
Wrong. You don't have to be a rocket scientist to repeat most of the basic calculations which give similar results.
Re:Climate Scientists refuse subpoena from Congress by moonchrome on Monday November 16, 2015 @02:03PM (#10576336)
Who cares if I can run a formula/program that tells me Y from X if I can't understand/trust the program/formula ?

If you think that stuff like economics/climatology/etc. has the same level of rigor and validation applied to it as established and verified theories from hard science then boy do I have some bad news for you (struggling for SD 2 as ideal vs SD 5 for eg.).

Re:Climate Scientists refuse subpoena from Congress by acqq on Monday November 16, 2015 @02:16PM (#10576436)
I see you don't want to trust even yourself in actually learning the formulas and the basic principles of physics behind them, but that's how it is. Physics works. Humans produce immense amounts of CO2, CO2 in the atmosphere increases the temperature of the planet. It's as simple as that.

Reading other people's mails won't refute the physics.

And no, other factors aren't the answer:

http://www.bloomberg.com/graphics/2015-whats-warming-the-wor...

Re:Climate Scientists refuse subpoena from Congress by thaumasiotes on Monday November 16, 2015 @05:39PM (#10577809)
Physics works, but that's because physicists don't even try to address large-scale phenomena like weather. Sufficient application of physics will let you know who's going to win the Super Bowl. And yet, nobody can do that.
Re:Climate Scientists refuse subpoena from Congress by acqq on Monday November 16, 2015 @05:46PM (#10577855)
But we don't ask who's going to win the Super Bowl. It's that we know that if we let 100 people in one isolated room to watch Super Bowl the room will be always warmer as long as people actually live in it and are allowed to eat (life also involves more heat from the food, assume we add them food all the time). The doubters claim that it doesn't have to happen. It does. We can calculate how much warmer approximately even if we can't be 100% sure for every minute, on the average the curve will match.

It's the same with the Earth. It's as isolated as the isolated room would be -- we know exactly how much heat can dissipate and how much must contribute to the increase of the temperature for the room, and we have quite good estimates for Earth too (less heat dissipates to the space when CO2 increases, and the Sun shines the heat nevertheless - we can nicely calculate even the contributions of the changes in orbit and some clever scientist did that even before the computers were available, it took years of calculations by hand then but it was done). We can be wrong for some particular year, but the direction and the average increase match.

The room is of course simpler than the Earth. Imagine having some water pumps, some fans and some chunks of ice in the room. You know the formulas for the water and ice but you have more to calculate for short term effects. But you still know there will be less ice as the time goes by and more water. And still always a bit warmer.

Re:Climate Scientists refuse subpoena from Congress by moonchrome on Monday November 16, 2015 @03:04PM (#10576779)
>Humans produce immense amounts of CO2, CO2 in the atmosphere increases the temperature of the planet. It's as simple as that.

CO2 is a green house gas - good job mr. high-school physicist - now show me the temperature projections along with human CO2 production graphs and estimated impacts and error margins and past model prediction performances vs measured data. You know the actual things that matter for policy implications. See that's where things go beyond high school.

Re:Climate Scientists refuse subpoena from Congress by acqq on Monday November 16, 2015 @03:22PM (#10576888)
There they are, they are agreed by the scientists of the whole world, so again no need to worry about the e-mails of one country's organization:

http://www.ipcc.ch/report/ar5/index.shtml

There are other countries among those who took part in making the reports who would be more than eager to point on anything that's wrong there. And nobody did find anything significant against.

Re:Climate Scientists refuse subpoena from Congress by moonchrome on Monday November 16, 2015 @03:33PM (#10576954)
>There are other countries among those who took part in making the reports who would be more than eager to point on anything that's wrong there. And nobody did find anything significant against.

Wait - but you didn't verify it your self ? After all :

>You don't have to be a rocket scientist to repeat most of the basic calculations which give similar results.

Or does it all boil down to trust and your original argument is nonsense.

Re:Climate Scientists refuse subpoena from Congress by acqq on Monday November 16, 2015 @03:37PM (#10576971)
Why does it matter what I have personally done or not done? Science works. E-mails are irrelevant. That's what we're discussing. If you claim that science doesn't work, you can prove that, but you have to know the science, or nobody will believe your claim. The major problem you'd have in order to prove that the current findings are wrong is that even the simplest formulas are against you. So you'd have to accept 99% of the existing results at the end and then to discover something completely new that amazingly nobody discovered up to now but that makes bigger influence on the results than everything known up to now. Good luck with that, as the data already add up now, as you can see in these graphs on the Bloomberg.