News for hackers. Stuff that matters.
Re:How thermometer and satellite data is adjusted and why it... by kapitza on Tuesday November 15, 2016 @05:39PM (#12962978)
This is actually an excellent illustration of how organizational incentives seep into data.

Imagine you have a historical temperature series record. You have an bureaucratic incentive to find and justify an argument as to why past temperatures should be adjusted downward, making the curve of global warming look steeper. You have no bureaucratic incentive to look for the opposite.

The result is that, overall, modern corrections adjust past temperatures downward -- what we'd expect if these biases exist. But this doesn't mean any specific correction is based on "fabricated" research. It's probably perfectly valid. It's just that downward corrections are more attractive to research, because they produce research that has a social impact that the field finds desirable.

(Edit: here's a picture of the net adjustments: https://judithcurry.com/2014/07/07/understanding-adjustments...)

Re:How thermometer and satellite data is adjusted and why it... by conistonwater on Tuesday November 15, 2016 @05:57PM (#12963094)
This is a pretty weak argument, because (a) arguments from scientific validity always trump arguments from incentives, (b) you seem to assume that the incentives you list are all the incentives there are. Do note, for example, that scientists also face the incentive to do good science that can stand up to the scrutiny of their peers. It's not enough to point out that the science has some impact and call it a day (after all, almost all good science has impact).

For this to be an "illustration", as you put it, you'd have to first demonstrate that what they did was scientifically dubious, then conclude that they must have done the dubious thing because of incentives. You can't just point at the sign of the adjustment and invoke incentives. I'd say you'd be much more convincing if you raised actual scientific issues, instead of making vague assertions about their incentives.

Re:How thermometer and satellite data is adjusted and why it... by kapitza on Tuesday November 15, 2016 @06:31PM (#12963281)
I think you're missing the point.

The negative adjustments of past temperatures are neither the work of one scientist, nor even one scientific organization. Let's say for simplicity that they're the result of ten entirely separate confirmed hypotheses about systematic errors in old data.

Each of these was produced by an honest researcher who followed the scientific method: formulate a hypothesis, test it, etc. Let's say their technical work is perfect. All the hypotheses are correct.

But all ten researchers, faced with the choice of what hypothesis to formulate and/or investigate, naturally chose high-impact hypotheses -- ones that, if confirmed, adjust past temperatures downward.

We would naturally expect historical errors in temperature measurements to be evenly distributed. Like errors in cheap thermometers. If they are evenly distributed, we would expect there to be ten other such hypotheses, involving upward corrections in past measurements, which were not studied because of their low impact if confirmed.

This hypothesis explains the data that we ourselves see: that past temperatures are continuously being lowered as the data evolves. And it requires no one to be a bad, incompetent, or dishonest researcher.

Re:How thermometer and satellite data is adjusted and why it... by woodchuck64 on Tuesday November 15, 2016 @07:07PM (#12963509)
> But all ten researchers, faced with the choice of what hypothesis to formulate and/or investigate, naturally chose high-impact hypotheses -- ones that, if confirmed, adjust past temperatures downward.

You have to show this, you can't just assume it. For example, sea surface temperature adjustments are the opposite; in your words, a low-impact hypothesis that is nevertheless formulated and confirmed. http://variable-variability.blogspot.de/2015/02/homogenizati...

Re:How thermometer and satellite data is adjusted and why it... by kapitza on Tuesday November 15, 2016 @07:42PM (#12963658)
That's a good point. On the other hand, the SST measurements are a lot lower impact (in terms of the number of times they're used in graphs that get into your newspaper) than air temperatures.

Which may be not be logical. But humans aren't logical.

For that matter, increases in air temperature in the 20th century by no means constitute definitive evidence of anthropogenic warming, since the planet has been warming for about four centuries. Finding the anthropogenic "signal" is a matter of number-massaging statistical wizardry, not at all unlike general circulation modeling.

If we had a sample of about 20 independent planets we could experiment on, it'd be no sweat. But science is hard. There's no law of nature that says the definitive experiment actually has to be practical. The definition of science is "we know," not "this is the best we can do."

Re:How thermometer and satellite data is adjusted and why it... by woodchuck64 on Tuesday November 15, 2016 @09:26PM (#12964058)
> What we don't understand (unless we decide GCMs are predictive and can be validated) is the impact of a given thermal forcing on planetary temperature. This is the "climate sensitivity." Unfortunately, this is the number we actually care about.

This is false, we do understand this well enough to be sure CO2 is a significant problem for warming, see http://www.realclimate.org/index.php/archives/2007/08/the-co...

Re:How thermometer and satellite data is adjusted and why it... by kapitza on Tuesday November 15, 2016 @10:35PM (#12964362)
The data quality in natural "experiments" like ice ages are as dubious as the GCMs, in the sense that you're simplifying very complex systems into single numbers. You'd never take this data set seriously next to the data you could get if you could mount a scratch planet and actually control the inputs.
Re:How thermometer and satellite data is adjusted and why it... by Daishiman on Tuesday November 15, 2016 @11:28PM (#12964545)
Explain to me how ice core sampling is a dubious science, since apparently the experts are it have been using it quite effectively to do science in many other fields apart from climate research.
Re:How thermometer and satellite data is adjusted and why it... by HillOBeans on Wednesday November 16, 2016 @09:11AM (#12966911)
That's the problem with any method used to try and determine information about the distant past: you have to make assumptions about your information-gathering method that may turn out to be incorrect. In the case of ice core samples, many scientists ASSUME that x number of layers corresponds to y number of years. Which is fine and dandy until some example comes along which throws that assumption into question. Consider, for example, the "lost squadron" of WWII. These planes were discovered over 200 feet deep under many layers of ice. Therefore, they must be many thousands of years old, right? Now, this doesn't mean that ALL deep ice structures are that young, but it certainly throws into question any conclusions drawn from ice core data. Now, this is my opinion, but I for one feel like many (not all) scientists continue to assume such methods are reliable and accurate. Perhaps they need the grant money. Perhaps they have devoted so much to their research that they just can't accept that all the time they spent drilling ice cores may have been wasted. Or (again, this is my opinion), perhaps they are climate change zealots who feel that they must convince the population they are right, regardless of the cost of their scientific integrity.
Re:How thermometer and satellite data is adjusted and why it... by HillOBeans on Wednesday November 16, 2016 @03:39PM (#12971267)
Since I am conveniently unable to respond to Mr. Woodchuck's comment below his, I'll make it here. You assume I am a creationist because.... I point out evidence that questions the validity of historical climate research - that happens to also be used by creationists? You miss the point. As the article you linked to to "refute" me itself indicates, ice layer accumulation is inconsistent. Therefore, any conclusions regarding historical events drawn from such data would have to be questioned. The fact that they were pointing out differing conditions leading to the rapid ice accumulation in Greenland is tacit admission that accumulation is not consistent and uniform. Who is to say that any other ice structure has been formed by consistent and predictable processes anywhere, when you are dealing with historic weather patterns? The ONLY way to be sure of such things is with an actual HISTORIC record, recorded by intelligent beings. My original comment was in reply to an assertion that ice core samples are a reliable source of scientific data, and your attempt at invalidating my argument by appealing to disdain for religion ("oh he must be a Creationist! Don't listen to him") is insufficient. I may actually believe in God, but I find comments such as yours to be all the more religious in their fervor.
Re:How thermometer and satellite data is adjusted and why it... by woodchuck64 on Wednesday November 16, 2016 @04:47PM (#12971885)
> You assume I am a creationist because....

Because the only reason to reject well-established scientific conclusions such as evolution and global warming is moral and emotional reasons deriving from membership in a Conservative Christian religous group that confuses the Bible with reality.

> As the article you linked to to "refute" me itself indicates, ice layer accumulation is inconsistent. Therefore, any conclusions regarding historical events drawn from such data would have to be questioned.

Which is exactly why ice is not dated solely by visible layers. An overview of ice core dating is here: http://www.pages-igbp.org/download/docs/magazine/2014-1/PAGE...

Instead, ice cores are dated by measuring independent signatures: isotopic compositions (reflecting season variations in local temperature) different kinds of impurity (reflecting seasonal dust and other mineral concentration), known events (such as volcanic eruptions, fires). In addition, there's a host of new methods and statistics being used and developed.

Effectively, there is no reason to reject the sound science behind ice-core dating unless your Church Group told you that God wants you to. But that's a silly way to find truth.

Re:How thermometer and satellite data is adjusted and why it... by woodchuck64 on Wednesday November 16, 2016 @02:58PM (#12970876)
You are a creationist so it is likely your moral and emotional need to believe in God is biasing and corrupting your understanding of science.

> Consider, for example, the "lost squadron" of WWII. These planes were discovered over 200 feet deep under many layers of ice. Therefore, they must be many thousands of years old, right?

This is straight from the Institute of Creation Research, known Liars for Jesus. This nonsense is dealt with here http://www.talkorigins.org/indexcc/CD/CD410.html. In short, ice layers are counted by many different methods and no one thinks that 200 feet deep automatically means thousands of years old.

Re:How thermometer and satellite data is adjusted and why it... by madaxe_again on Wednesday November 16, 2016 @03:24AM (#12965329)
It's good science - but you'll find that hard to tell amidst the astroturfing armies Thiel has installed here.

An analogy would be to sit in a burning building, arguing that until we've seen the building completely burn down, we can't be sure it's on fire, so there's no point in turning off the gasoline hoses.

All of those suggesting that scientists universally introduce bias are sorely lacking an understanding of the scientific method and process, and confuse their own compromised morals for those of others.

Edit: the fact that this is being vigorously downvoted on a no longer front page story with few new comments only confirms my suspicions. Do you do it for money, the lulz, or do you have a genuine ideological connection to the idea of eradicating the majority of humans?

Re:How thermometer and satellite data is adjusted and why it... by TeMPOraL on Wednesday November 16, 2016 @05:39AM (#12965898)
1. It's still a front-page story for me (I've been wondering how HN determines front page nowadays, I'm starting to suspect it's not the same for everyone).

2. You're probably being downvoted for the "astroturfing armies Thiel has installed" thing.

Re:How thermometer and satellite data is adjusted and why it... by madaxe_again on Wednesday November 16, 2016 @06:32AM (#12966124)
2 is no less disprovable than the objections to climate science - and can be argued in favour of with identical arguments. Yet it is for some reason less credible than climate change denial.
Re:How thermometer and satellite data is adjusted and why it... by woodchuck64 on Wednesday November 16, 2016 @02:52PM (#12970797)
I'm with you, the disinformation campaign is growing here.
Re:How thermometer and satellite data is adjusted and why it... by madaxe_again on Wednesday November 16, 2016 @03:43AM (#12965387)
Can you prove that you're not a Markov chain? Until proven otherwise the above is just random word salad thrown together by an algorithm.
Re:How thermometer and satellite data is adjusted and why it... by woodchuck64 on Tuesday November 15, 2016 @08:49PM (#12963930)
> For that matter, increases in air temperature in the 20th century by no means constitute definitive evidence of anthropogenic warming, since the planet has been warming for about four centuries.

If by definitive, you mean 100%, then yes, else no. The IPCC distilled the consensus down to about 95% which is quite strong, by all means.

Re:How thermometer and satellite data is adjusted and why it... by 7952 on Wednesday November 16, 2016 @01:21AM (#12964933)
It seems unlikely that the earths atmosphere would remain unaffected by human impacts.
Re:How thermometer and satellite data is adjusted and why it... by newtohn on Tuesday November 15, 2016 @09:15PM (#12964019)
The SST adjustments have a larger impact on global temperatures than the land adjustments. Hence the global temperature has been adjusted higher relative to the raw data for the period before 1940.
Re:How thermometer and satellite data is adjusted and why it... by kapitza on Tuesday November 15, 2016 @10:42PM (#12964384)
This is inconsistent with Hausfather's numbers, which you can see at the link above. Net global and US temps are both adjusted lower.

I can't explain the discrepancy. Someone is being clever, that's for sure.

Re:How thermometer and satellite data is adjusted and why it... by cfmcdonald on Tuesday November 15, 2016 @06:38PM (#12963323)
But your whole premise is false. From the OP: "And to upend the inevitable backlash that news will receive (spoiler alert), using all the raw data without performing any analysis would actually produce the appearance of more warming since the start of records in the late 1800s."
Re:How thermometer and satellite data is adjusted and why it... by kapitza on Tuesday November 15, 2016 @06:47PM (#12963387)
I don't know how they came up with this sentence. I'm sure it is true in some sense of the word "true." But just look at the data:

https://judithcurry.com/2014/07/07/understanding-adjustments...

Perhaps OP is talking about some older data before the cutoff of this graph.

Edit: the Guardian article posted elsewhere shows the opposite:

https://www.theguardian.com/environment/climate-consensus-97...

Amusingly, the Guardian illustration is credited to the same person who wrote the article I cite: Zeke Hausfather.

Welcome to the world of climate statistics. When bar charts drive trillions of dollars in public policy, they tend to get pretty wonky, pretty fast...

Re:How thermometer and satellite data is adjusted and why it... by newtohn on Tuesday November 15, 2016 @09:13PM (#12964013)
It is due to the adjustments of the ocean temperature data. The SST data has been adjusted upward. Due to the adjustments the global temperature is estimated to be warmer in the past than the raw data show (http://variable-variability.blogspot.com.au/2015/02/homogeni...)
Re:How thermometer and satellite data is adjusted and why it... by xenadu02 on Tuesday November 15, 2016 @11:20PM (#12964509)
Your posts seem like classic climate change denialism. The same tactics were used to argue that lead in gasoline wasn't a problem and that cigarette smoke doesn't cause cancer.

CO2 causes atmospheric warming. The underlying principles are simple and sound. We are emitting tons and tons of CO2 by burning vast quantities of fossil fuels.

The only reason to argue against the science is if you have an ulterior motive or you've been unwittingly duped by those that do.

>But all ten researchers, faced with the choice of what hypothesis to formulate and/or investigate, naturally chose high-impact hypotheses

That isn't how science works. It doesn't matter what they hypothesize, what matters is what the evidence shows.

>We would naturally expect historical errors in temperature measurements to be evenly distributed.

No we wouldn't and you refuse to offer any evidence to back up your claims.

>If they are evenly distributed, we would expect there to be ten other such hypotheses, involving upward corrections in past measurements, which were not studied because of their low impact if confirmed.

I'm going to be direct and honest here: This is why I think you're just lying to push a point. This is not how the scientific method works. None of what you've postulated is correct. And for the record there are various groups (including some oil companies) pouring millions into scientific studies trying to prove global warming isn't happening. None of their supposed "evidence" has withstood peer review or scrutiny.

Evidence is what ultimately matters, a point you seem to be trying really hard to avoid addressing.

Re:How thermometer and satellite data is adjusted and why it... by hueving on Wednesday November 16, 2016 @01:48AM (#12965021)
Your post is also lacking many concrete details so it's not adding to the conversation.

>Your posts seem like classic climate change denialism.

Any skeptical post would qualify for this.

>The same tactics were used to argue that lead in gasoline wasn't a problem and that cigarette smoke doesn't cause cancer.

The same tactics (attacking data sources) are used in any critical analysis of a given scientific field (see sociology).

>CO2 causes atmospheric warming.

Repeating the conclusion is not an argument.

>The underlying principles are simple and sound.

Right, but the underlying principle isn't being disputed. The underlying principles behind lots of research can be fine while the research itself is garbage (e.g. bad data collection methodology).

>The only reason to argue against the science is if you have an ulterior motive or you've been unwittingly duped by those that do.

This is so idiotic I don't even know where to start. You're saying that there is no reason to question scientific findings if you think a whole method of research is fundamentally flawed?

"The only reason you have to argue against numerology is if you have an ulterior motive or you've been unwittingly duped by those that do."

Sounds silly, doesn't it?

>That isn't how science works. It doesn't matter what they hypothesize, what matters is what the evidence shows.

Cute, I take it you've never worked in academia? People completely throw away experiments that fail to support their hypothesis all of the time. Especially if the result would bring down a fire of threats to their career. (https://xkcd.com/1478/ https://xkcd.com/882/)

Bias in the researchers is a very big problem in all scientific fields. When you're trained to be a hammer and all you work with are hammers, and you get your funding from the hammer use-case fund, you certainly aren't out looking for screwdriver use-cases.

Please keep the discussion to substantive counterpoints other than ad hominems, strawman arguments, and appeals to authority.

Re:How thermometer and satellite data is adjusted and why it... by magicalist on Wednesday November 16, 2016 @02:29AM (#12965158)
> Your post is also lacking many concrete details so it's not adding to the conversation.

Your post is nonsense in context. The top post provided no concrete details, so what details could the GP use but to quote it directly?

It was a non-falsifiable theory devoid of evidence; by their logic, we can't listen to experts because they're experts. All research is subject to systemic and directed bias, discernible without actually looking at that research.

It's dumb and not remotely concrete. And it's certainly a time honored diversionary and denialist tactic.

> Bias in the researchers is a very big problem in all scientific fields. When you're trained to be a hammer and all you work with are hammers, and you get your funding from the hammer use-case fund, you certainly aren't out looking for screwdriver use-cases. Please keep the discussion to substantive counterpoints other than ad hominems.

I'd suggest maybe doing a little self reflection before posting? This entire thread is fundamentally an ad hominem argument, and this quote just doubles down.

Re:How thermometer and satellite data is adjusted and why it... by madaxe_again on Wednesday November 16, 2016 @03:37AM (#12965365)
Hacker news agrees with him, not you. Take your elitist ration and logic elsewhere, it's not welcome here. I've just about given up on this place - I think Thiel has been astroturfing for years and it's getting worse.
Re:How thermometer and satellite data is adjusted and why it... by hueving on Wednesday November 16, 2016 @07:28PM (#12973028)
>Take your elitist ration and logic elsewhere

Did you read my post? It was pointing out that that the parent's post was lacking ration and logic and was resorting to ad homs, strawmen, and appeals to authority.

Re:How thermometer and satellite data is adjusted and why it... by vixen99 on Wednesday November 16, 2016 @02:44AM (#12965206)
'CO2 causes atmospheric warming. The underlying principles are simple and sound. We are emitting tons and tons of CO2 by burning vast quantities of fossil fuels.'. Yes, we know all this and there isn't a single skeptical scientist from Richard Lindzen onwards (and let's include the non-scientist Myron Ebell) who takes issue with that statement. The core question is a quantitative not qualitative one.

By the way, who are the groups 'pouring millions' and where do they state that they are 'trying to prove global warming is not happening'? It's probably best to keep to salient facts because 'None of their supposed "evidence" has withstood peer review or scrutiny' is a cheap, easy aside to make if we don't know who they are or to which evidence you're referring.

Re:How thermometer and satellite data is adjusted and why it... by kansface on Tuesday November 15, 2016 @09:25PM (#12964051)
Consider the history of the charge of the electron according to Feynman:

> It's interesting to look at the history of measurements of the charge of an electron, after Millikan. If you plot them as a function of time, you find that one is a little bit bigger than Millikan's, and the next one's a little bit bigger than that, and the next one's a little bit bigger than that, until finally they settle down to a number which is higher.

http://hsm.stackexchange.com/questions/264/timeline-of-measu...

Re:How thermometer and satellite data is adjusted and why it... by magicalist on Tuesday November 15, 2016 @09:33PM (#12964081)
> Consider the history of the charge of the electron according to Feynman

Which is just as good an argument for the adjustments still being too high. Or being exactly right. The real question is, what evidence is there that this is an analogous situation?

Feynman's point was vigilance in scientific research, not that any dataset can be handwaved away by pointing out an unrelated anecdote.

Re:How thermometer and satellite data is adjusted and why it... by Torgo on Tuesday November 15, 2016 @07:42PM (#12963659)
>arguments from scientific validity always trump arguments from incentives

The science is settled, human behavior is heavily influenced by incentive. Including the practice of science.

Re:How thermometer and satellite data is adjusted and why it... by BurningFrog on Tuesday November 15, 2016 @10:13PM (#12964268)
I think this is an illustration of how incentives can skew results across a scientific field, without anyone colluding or being deliberately deceptive.
Re:How thermometer and satellite data is adjusted and why it... by nl on Wednesday November 16, 2016 @06:10AM (#12966044)
I'm going to reply to the top comment here, rather than everywhere else in this thread.

This comment is complete nonsense.

Or rather, it is the perfect example of the type of comment that is impossible to argue against because it is specifically designed to be never wrong.

Instead of trying to argue (for example) that one shouldn't adjust for things like changing the time temperature is measured from the morning to the afternoon, the argument is that "there is an incentive".

It's clearly useless to argue against this. One could make the point that there is always large amounts of funding available for anyone to go against the climate change consensus, but then we'd end up arguing details of funding models etc which would (in the main) be completely ignored.

You'll note that there is the concession But this doesn't mean any specific correction is based on "fabricated" research. It's probably perfectly valid. - but you'll also note that the author goes on arguing motivation points, and saying things like "it requires statistical wizardry" and questioning ice core data etc.

This is such an attractive technique for arguing on forums. It's just about impossible to stop, and much more damaging than "fake news" IMHO.

Re:How thermometer and satellite data is adjusted and why it... by mannykannot on Wednesday November 16, 2016 @09:20AM (#12966968)
This is an excellent analysis of a bogus argument, and demonstrates the proper way to deal with its ilk. When an 'argument' is constructed from innuendo, when it nominally concedes its failings where they butt against inconvenient truths, but then continues as if it had not, then there is little point in arguing against it with the facts - that is how you conduct a dialog with people who are honest in their opinions. Instead, the best response to this sort of thing is to expose the inconsistent, fallacious and possibly deceitful form of the argument itself.
Re:How thermometer and satellite data is adjusted and why it... by cfmcdonald on Tuesday November 15, 2016 @05:56PM (#12963085)
This graph shows the opposite of what you claim, NOAA adjusted temperatures are higher than the raw data for 1880-1940:

https://www.theguardian.com/environment/climate-consensus-97...

Re:How thermometer and satellite data is adjusted and why it... by arctictern on Wednesday November 16, 2016 @05:07AM (#12965766)
Um, even if you subscribe to agw, shouldn't we be at least a little bit skeptical of estimates of ocean temperature before WWII? I mean that article has a chart of global temperatures going back to 1850. How the frog do they know what global average ocean temperatures were 35 years before the automobile was invented?

So I think that the guy mentioned in the article, Peter Thorne, is the main person responsible for assertions about ocean surface temperatures pre-WWII. I read one of his older papers (I'm having trouble finding it right now), where he describes how he estimates the ocean surface temperatures from way back then. You have to admire his confidence/optimism in making those estimates, but to me the paper was not completely distinguishable from an Onion[1] article. Apparently back then seafaring ships used to measure ocean temperature[2] by lowering a bucket tied to a rope over the side, pulling it back up and then sticking a thermometer in the bucket (full of ocean water). Iirc, the water in the bucket could have cooled or heated by up to something like 5 degrees by the time a temperature reading was taken. He then proceeds to estimate(/guess) the amount of cooling/heating by factoring in the average elevation of a ship's deck (as a function of date) and how long it would take an average person to pull the bucket back onto the deck. He also factors in things like the typical material a bucket would be made of (also as a function of date).

To me, he seems to give off a vibe of being really proud of his "rube-goldbergian" estimates, but personally, I'm not as confident as he (and apparently everybody else) is in those estimates. And since ships only traversed a small portion of the oceans in those days (the trade routes, generally), there is a lot of extrapolation involved. And assumptions about the correspondence of ocean temperatures and nearby land temperature readings.

Imo, the accuracy, or lack thereof, of pre-WWII ocean surface temperature estimates is not super relevant to the task of constructing predictive climate models. But it does seem to me to be perhaps an indication of an insufficiency of healthy self-skepticism in the climate science community.

[1] https://en.wikipedia.org/wiki/The_Onion

[2] This is actually because Benjamin Franklin did it and discovered the Gulf Stream, which is pretty cool.

Re:How thermometer and satellite data is adjusted and why it... by arctictern on Wednesday November 16, 2016 @07:01AM (#12966241)
And my sincerest apologies to Peter Thorne. My statements about him were completely inaccurate. If I could delete the comment, I would.

After some googling, this paper may be related to the one I recalled reading: ftp://podaac.jpl.nasa.gov/allData/gosta_plus/retired/L2/binary/docs/document/papers/3_clmchg/3_clmchg.htm

Re:How thermometer and satellite data is adjusted and why it... by arctictern on Wednesday November 16, 2016 @06:01AM (#12966002)
Yeah, sorry about the low quality comment. But the more sincere point was, don't claims to know the global average ocean surface temperature in the 19th century with some accuracy qualify as "extraordinary claims"? I feel uncomfortable just accepting it without a) extraordinary proof, or b) some explanation why it's actually not so extraordinary, or c) maybe error bars or uncertainty clouds on the graph?
Re:How thermometer and satellite data is adjusted and why it... by bsder on Tuesday November 15, 2016 @09:31PM (#12964071)
> You have no bureaucratic incentive to look for the opposite.

Totally false.

Data which proves the opposite of the general consensus and is scientifically defensible would be of massive impact.

Your name would be everywhere AND every climate change denier would be trumpeting your results. You would be famous AND well-funded for life.

The problem is that you WILL come under heavy scrutiny, so your data, methods, and conclusions better be beyond reproach. Everyone who has attempted to defend the opposite of the consensus, so far, has collapsed when challenged.

Re:How thermometer and satellite data is adjusted and why it... by arctictern on Wednesday November 16, 2016 @03:24AM (#12965324)
If only that were true. If you remember a few years ago, an experiment seemed to (incidentally) show particles travelling faster than the speed of light [1], which would have been an exception to Einstein's well established theory. The researchers, did not assert that their observation was valid, but instead were asking the wider community to help them find the flaw in their experiment. But just the remote possibility that there might be the obscurest of exceptions to the theory set the physics world abuzz. Had the observation been confirmed, the researchers would indeed be famous.

But in contrast, for example, studies have now effectively discredited the widespread and long-standing belief in the effectiveness of mammograms [2]. Are the authors of those studies rich and/or famous? Have we as a society redirected resources from executing and encouraging mammograms to potentially more effective solutions? Not really, I would say.

So why the discrepancy?

A number of reasons I'm sure, but imo the biggest factor is probably RTP (repeatably testable predictions). Fields of science where it's easy to make and test predictions tend to be very different (in quality) from fields where it is difficult/expensive/impossible to test predictions.

Guess which category climate science falls into?

The (not-yet-testable) long term predictions of the climate scientists may turn out to be right, but the shorter term testable ones have an unimpressive track record [3].

Genuine question: Does anyone here have confidence in the common agw claims based on their direct analysis of the data/science (rather than their analysis of the credibility of the parties)? If so, could you give a brief explanation?

[1] https://en.wikipedia.org/wiki/Faster-than-light_neutrino_ano...

[2] http://www.bmj.com/content/348/bmj.g366

[3] http://www.stat.washington.edu/peter/statclim/fyfeetal.pdf

Re:How thermometer and satellite data is adjusted and why it... by andrewflnr on Wednesday November 16, 2016 @04:33AM (#12965602)
bsder's argument depends specifically on the highly political nature of the climate change question, so mammograms aren't exactly a good comparison.
Re:How thermometer and satellite data is adjusted and why it... by adrr on Wednesday November 16, 2016 @12:47AM (#12964819)
You don't work for NOAA as a scientist to become famous and rich. These are passion jobs. You get it from both sides. Publish something conservatives don't like, get hauled in front of congress to testify. Publish something environmentalist don't like get called a shill for the oil industry. Every side will twists your words and take statements out of context. Its pretty shitty how we treat our scientists.
Re:How thermometer and satellite data is adjusted and why it... by vixen99 on Wednesday November 16, 2016 @05:32AM (#12965875)
Rotten! And sometimes your 'good news' won't even make it to the headlines in certain publications as in the following.

"NOAA’s Storm Prediction Center indicate that as of today, the total count for 2016 of US tornadoes are fewest in a calendar year since record-keeping began in 1954."

Re:How thermometer and satellite data is adjusted and why it... by rconti on Tuesday November 15, 2016 @06:42PM (#12963339)
The article said all of the adjustments to historical data adjusted those temperatures UP, which is the exact opposite of what you're claiming is incentivized.
Re:How thermometer and satellite data is adjusted and why it... by magicalist on Tuesday November 15, 2016 @08:47PM (#12963925)
What a terrible top comment. Classic middle brow dismissal, no reading the article or responding to any substantive point required.

> The result is that, overall, modern corrections adjust past temperatures downward -- what we'd expect if these biases exist.

Yes, yes, just like "I didn't kill that person" is exactly what we'd expect a murderer to say. Also all the non-murderers, sure, but we're looking for a murderer and here's this person saying just what they'd say!

You've prevented zero evidence. Your argument is entirely postulation. We're in FSM/Russell's teapot territory here; with no evidence your made-up theory is as likely as any other postulate.

Maybe it was twice as cold but researchers have rounded up as the numbers seemed too preposterous! Maybe the numbers went complex in the 1800s but none of our proxies are set up to measure imaginary temperatures!

Re:How thermometer and satellite data is adjusted and why it... by mturmon on Wednesday November 16, 2016 @12:56AM (#12964853)
Thanks for this. I've grown tired of discussions with these HN armchair skeptics, who typically have no publications in the area and a shallow science background relative to the complexity of the issues they raise.

As you say, there is no way to refute the claims advanced by the comment. It's just an abstract argument about forces and tendencies.

The scientific motivations leading to this calibration to eliminate systematic effects have a lot more internal checks than the comment acknowledges.

Re:How thermometer and satellite data is adjusted and why it... by madaxe_again on Wednesday November 16, 2016 @04:13AM (#12965504)
This is sadly the general vein of HN, and of all online communities - no matter what you try, September comes.

I used to come to HN to learn things. Now I come here to try to defend any worldview other than "TV said so". The only thing I'm really learning is that the technocratic class cannot be trusted with questions of nuance, politics, or morality.

There's an example from history in the early Soviet Union, and the effects of technocratic management on their economy - and in a later regime I won't name how my great uncle found himself shipped to Stalingrad. "Siegfried, we are not here to discuss whether we should be using forced labour, we are here to discuss how to use it." He was a hydrological engineer, they had him designing power plants that could be installed by unskilled forced labour. He objected, got sent to Stalingrad, and escaped with his life because he got hepatitis and was airlifted out under a dead man's name. The vast majority just complied because it was an interesting problem and "not their place" to pass judgment, or think.

I digress, but I do worry about where this "discourse" is headed, and i had honestly deluded myself into thinking we could be better.

Re:How thermometer and satellite data is adjusted and why it... by adwhit on Wednesday November 16, 2016 @03:08AM (#12965275)
It really is a terrible indictment of HN that it could be the top comment. We should be 15 years beyond these kind of smears.
Re:How thermometer and satellite data is adjusted and why it... by pavlov on Tuesday November 15, 2016 @07:43PM (#12963664)
Why assume that climate scientists find global warming desirable? Most scientists don't wish to see their unique research subject destroyed.

It's like claiming that mass extinctions of species are probably not happening, biologists are just biased and want to make their field look more important... The argument is absurd when applied to biology, but somehow climate science is considered "crooked" it seems.

Re:How thermometer and satellite data is adjusted and why it... by inimino on Wednesday November 16, 2016 @09:29AM (#12967045)
I read your comment both and after reading the article. Before, it seemed like a reasonable issue to raise. After, it seems like you either didn't read the article or just responded to a completely unrelated fantasy of your own making.

> This is actually an excellent illustration of how organizational incentives seep into data.

For that claim to be anything other than bullshit, you would need to show that they actually have seeped in. Instead, what you showed is a creative hypothesis about how that might happen, supported by no evidence, and with a glaring hole.

The glaring hole in your hypothesis is that there is intense skepticism of climate change and the incentive structure you imagine simply doesn't exist.

What you've written is a nice way to cast doubt on the data, which is a bit unfortunate given where the science and the politics actually stand.

Re:How thermometer and satellite data is adjusted and why it... by cpncrunch on Tuesday November 15, 2016 @05:43PM (#12963001)
A lot of it depends on the integrity of the researchers, and I would suspect NOAA scientists have more integrity than the average "bureaucrat".
Re:How thermometer and satellite data is adjusted and why it... by kapitza on Tuesday November 15, 2016 @05:48PM (#12963023)
You don't need dishonest researchers to see this effect. You just need researchers who care, personally and/or professionally, about the impact of their work.

I'm sure Mr. Spock is a professor somewhere. If you talk to real working scientists, you'll find very few Spocks. Also, there are not a lot of Victorian gentleman-scientists; they all need to be funded...

Re:How thermometer and satellite data is adjusted and why it... by cpncrunch on Tuesday November 15, 2016 @08:08PM (#12963763)
Sure, but my point is that some scientists are more trustworthy than others, just like some newspapers are more trustworthy.
Re:How thermometer and satellite data is adjusted and why it... by monkmartinez on Tuesday November 15, 2016 @11:17PM (#12964493)
Eh, the idea of "trust" gets into non-quantifiable territory very quickly. Further, your analogy with newspapers is, quite frankly, not good. I would say that generally speaking, if a newspaper consistently confirms one's biases it is more likely to be deemed "trustworthy" and vice-versa with "non-trustworthy" newspapers.
Re:How thermometer and satellite data is adjusted and why it... by cpncrunch on Wednesday November 16, 2016 @10:22AM (#12967677)
No thats simply not true. Is a random personal blog as trustworthy as the globe and mail?
Re:How thermometer and satellite data is adjusted and why it... by djsumdog on Tuesday November 15, 2016 @06:07PM (#12963152)
You wouldn't expect regular human beings to be subject to confirmation bias? Scientist are people and have opinions. No matter how logical we think we are, all of us have bias. In fact a good scientists is always willing to doubt his or her axioms. Doubt is the pillar of new discoveries and innovation:

http://khanism.org/science/doubt/

Re:How thermometer and satellite data is adjusted and why it... by jackmott on Tuesday November 15, 2016 @06:47PM (#12963384)
The researchers picked by the Koch brothers (Berkely Earth Science) get the same results for temperature reconstructions guys. This stuff is real. You don't even have to do adjustments to get essentially the same trend, you can verify this with excel, all by yourself.
Re:How thermometer and satellite data is adjusted and why it... by cpncrunch on Tuesday November 15, 2016 @07:52PM (#12963711)
>You wouldn't expect regular human beings to be subject to confirmation bias?

Strawman. Nobody mentioned confirmation bias. We are talking about "bureaucratic incentive", i.e. fudging results to please your boss.

Re:How thermometer and satellite data is adjusted and why it... by monkmartinez on Tuesday November 15, 2016 @07:04PM (#12963487)
Why? Just a feeling? Like most things the truth probably lies somewhere in the "middle."
Re:How thermometer and satellite data is adjusted and why it... by woodchuck64 on Tuesday November 15, 2016 @08:55PM (#12963955)
In very few things the truth lies somewhere in the "middle". You either have rigorous treatment of evidence combined with methodological design to reduce or eliminate human bias, i.e. sciences, or you have what someone believes based on uncontrolled emotional bias.
Re:How thermometer and satellite data is adjusted and why it... by monkmartinez on Tuesday November 15, 2016 @11:21PM (#12964514)
Ok... according to woodchuck64, We live in the land of PURE unbiased science! There are ZERO reasons to lean on or massage data one way or another. Funding just comes in, no matter the conclusions.
Re:How thermometer and satellite data is adjusted and why it... by woodchuck64 on Wednesday November 16, 2016 @03:04PM (#12970933)
> Ok... according to woodchuck64, We live in the land of PURE unbiased science! There are ZERO reasons to lean on or massage data one way or another. Funding just comes in, no matter the conclusions.

I didn't say we live in a land of pure unbiased science. However, you can be certain that those insisting that science is biased are basing their conclusions on vastly more biased sources of information than science itself. In one thread, we have a climate science denier who obviously gets moral and emotional comfort from a right-wing political point of view; in another, a creationist who gets moral and emotional comfort from Conservative Christianity. They don't seem to realize that to criticize science effectively, you can only approach from a position with less human bias than practiced science, not more.

Re:How thermometer and satellite data is adjusted and why it... by cpncrunch on Tuesday November 15, 2016 @07:54PM (#12963717)
The same reason I think that the Globe and Mail or CTV is more reliable than some random ranting blog site.
Re:How thermometer and satellite data is adjusted and why it... by snowwrestler on Tuesday November 15, 2016 @10:07PM (#12964238)
There is no actual substance to this argument. It's just taking a couple simple facts and applying some logic and imagination. Anyone can do it--no subject matter expertise required. Which probably explains why this sort of argument is popular in HN and other online forums.

It's fun to think about, but not very informing or insightful.

Re:How thermometer and satellite data is adjusted and why it... by mannykannot on Tuesday November 15, 2016 @08:39PM (#12963888)
> This is actually an excellent illustration of how organizational incentives seep into data.

Where is the supporting evidence of organizational incentives actually seeping into the data, as opposed to a meaningless correlation? Without such evidence, you don't have an illustration of it, you have just another conspiracy theory.

Re:How thermometer and satellite data is adjusted and why it... by nitwit005 on Wednesday November 16, 2016 @02:26AM (#12965150)
If we exclude the criticism of your peers who will likely question your conclusions, it's probably better to be a climate change denier. A subgroup of people will hail you as a hero, it seems to dramatically increase your odds of being invited to speak in congress, and your budget is less likely to vanish under a conservative government.