News for hackers. Stuff that matters.
Re:We Used Broadband Data We Shouldn’t Have by code4tee on Friday January 12, 2018 @11:32AM (#16134098)
Nice to see they’re being so transparent about setting the record straight. Mistakes like this happen in the journalism business, but few outlets make a serious effort correct misreporting beyond burying corrections where nobody sees them.
Re:We Used Broadband Data We Shouldn’t Have by stusmall on Friday January 12, 2018 @12:36PM (#16134630)
Overall they do such a good job of that. They seem to really value self-improvement and reflection. Its part of what keeps me as a regular reader. One editor even does a yearly public review of the work he did that year, what he did wrong, and how he plans on improving it.

https://fivethirtyeight.com/tag/mea-culpa/

Re:We Used Broadband Data We Shouldn’t Have by taoistextremist on Friday January 12, 2018 @01:35PM (#16135132)
Harry Enten is probably my favorite personality of FiveThirtyEight, mainly because of the amount of humility he has despite the fact that he's very good at his job from what I can tell.
Re:We Used Broadband Data We Shouldn’t Have by colemannugent on Friday January 12, 2018 @11:36AM (#16134126)
Yeah, most news outlets will edit the original article with a small correction. Props to them for a full postmortem article.
Re:We Used Broadband Data We Shouldn’t Have by blensor on Friday January 12, 2018 @02:16PM (#16135472)
I am usually not one who favors government regulation of journalistic outlets, however I do have a proposal.

Media outlets should be required to publish a correction of a story at least as visible and for at least as long as the initial incorrect version.

This would prevent a site from first claiming something and then burying the correction somewhere where nobody finds it.

Re:We Used Broadband Data We Shouldn’t Have by FabHK on Friday January 12, 2018 @02:31PM (#16135564)
In Germany, people covered by factual statements in the news have a right (under certain conditions) to demand a "Gegendarstellung" presenting their reply (consisting only of factual statements, not opinions), and that reply has to be in an equally prominent location/size/etc in the same media outlet.

https://en.wikipedia.org/wiki/Right_of_reply

https://de.wikipedia.org/wiki/Gegendarstellung

Re:We Used Broadband Data We Shouldn’t Have by bonzini on Friday January 12, 2018 @02:38PM (#16135633)
Of course factual statements need not be true. There was a famous case in Italy where a politician denied having been incarcerated, while sending his reply from a state prison.
Re:We Used Broadband Data We Shouldn’t Have by blensor on Friday January 12, 2018 @02:53PM (#16135768)
Does a "Gegendarstellung" not require a court order?

I would very much love if the media outlets agree on self imposed "best practices for corrections".

Which in the end should be a benefit for those complying because they can advertise it and be more believable

Re:We Used Broadband Data We Shouldn’t Have by hwh on Friday January 12, 2018 @04:14PM (#16136354)
The right exists without a court order (and I'd wager it is more often granted than not by established outfits, with notable exceptions like tabloids - like Germany's largest newspaper Bild - and the yellow press). However, some will have to resort to go to the courts if the publishing entity does not comply. Which will take some effort, it being a civil rights matter - e.g. paying court fees up front (and claiming the money back in the same suit, leaving the applicant with the risk of an opposing party with no money).
Re:We Used Broadband Data We Shouldn’t Have by 18pfsmt on Friday January 12, 2018 @03:55PM (#16136214)
I think a specific subdomain or directory for all corrections would also be helpful. Visibility should be long term without an expiration or redirect.
Re:We Used Broadband Data We Shouldn’t Have by blensor on Friday January 12, 2018 @05:26PM (#16136896)
A separate list of corrections would definitely be a good counterbalance, but it would probably only matter to those who are already trying to verify the correctness of the story in the first place and not to those who took it at face value.
Re:We Used Broadband Data We Shouldn’t Have by colemannugent on Friday January 12, 2018 @05:07PM (#16136745)
This would require the government determine "the truth" which is probably a really bad idea.

I'm curious, how would you punish those who did not comply?

Re:We Used Broadband Data We Shouldn’t Have by bglusman on Friday January 12, 2018 @05:31PM (#16136930)
would it, or would it leave it up to the article publisher, but say IF AND WHEN you issue a retraction/correction, here is the way you must do it? I don't know that I agree with the proposal per se, but I think this specific criticism is misguided/wrong.
Re:We Used Broadband Data We Shouldn’t Have by colemannugent on Friday January 12, 2018 @10:24PM (#16138119)
Say the fed implemented this as you described: Why would any news company bother issuing corrections then?

Publishers would just silently edit the article, forcing the federal government to monitor all news outlets content for changes. In the face of this daunting task, some naive senator would suggest that all news first be submitted to the fed for review.

The only solution to this problem is the nationalization of the news media, which would be a very bad thing. Sometimes the only way to win is not to play.

Re:We Used Broadband Data We Shouldn’t Have by wutbrodo on Friday January 12, 2018 @04:45PM (#16136608)
Yea, 538 is one of the only outlets I can think of that quietly lives up to the standards that most media entities seem to think they hold themselves to.

They're like Vox, minus the self-back-patting about intellectual honesty and plus the _actual_ intellectual honesty.

Re:We Used Broadband Data We Shouldn’t Have by rayiner on Friday January 12, 2018 @01:14PM (#16134950)
Yeah this is wonderful. Some of the original data just didn’t make sense. For example, London County, which is home to the Dulles technology corridor and has the highest median income of any county in the US, with a 3.5% poverty rate, has only 50% home broadband uptake?
Re:We Used Broadband Data We Shouldn’t Have by mobilefriendly on Friday January 12, 2018 @01:22PM (#16135008)
I live a few miles outside of Loudoun County, still in DC metro, and I have NO terrestrial internet access beyond dialup. It is quite possible that large sections of Loudoun don't have real broadband, just DSL. The county doesn't even have 100% cell phone coverage. There's Dulles/Leesburg, and everywhere else.
Re:We Used Broadband Data We Shouldn’t Have by rayiner on Friday January 12, 2018 @05:49PM (#16137022)
Where is a few miles outside of Loudon? Clarke County? That’s closer to WV than DC. And incredibly sparsely populated. Clarke is 85 people per square mile and Fauquier is 105. Fairfax County is 2,800.

Parts of Loudoun are very sparsely populated; indeed, it has the most unpaved roads of any county in VA. But since 1980, the population has grown from 60,000 to 385,000. Almost all of that growth has been in Dulles/Leesburg/Ashburn, etc. So in terms of percentage of households who have broadband access, the other parts of the county doesn’t have much of an impact on the overall number.

Re:We Used Broadband Data We Shouldn’t Have by Shivetya on Friday January 12, 2018 @02:25PM (#16135522)
most people don't realize how dismal even cellular coverage is in many parts of the country. they worry about broad band yet we cannot even guarantee you have coverage with any mobile device. worse people fight against it too
Re:We Used Broadband Data We Shouldn’t Have by stordoff on Friday January 12, 2018 @02:25PM (#16135523)
Why is DSL not "real broadband"?
Re:We Used Broadband Data We Shouldn’t Have by beardicus on Friday January 12, 2018 @02:37PM (#16135612)
Because the current US govt definition of "broadband" is a minimum of 25mbps down, and most DSL can't achieve those speeds.
Re:We Used Broadband Data We Shouldn’t Have by mynameisvlad on Friday January 12, 2018 @03:12PM (#16135918)
According to footnote 11, the FCC data set uses 10/1 as the definition of "broadband"
Re:We Used Broadband Data We Shouldn’t Have by maxsilver on Friday January 12, 2018 @03:48PM (#16136167)
That's a recent change, broadband used to be defined as 25mbps, and that definition was recently lowered to 10mbps.

But for what it's worth, a lot of US DSL still wouldn't meet broadband definition, even using your lower speed definition. AT&T DSL (the non-FTTN version) in Michigan maxes out around 6mbps down for most people.

Re:We Used Broadband Data We Shouldn’t Have by PaulHoule on Friday January 12, 2018 @04:04PM (#16136268)
I have two DSL lines, one 1 Mbps, the other 2 Mbps thanks to a patented range extender is no longer manufactured because the patent holder got acquired.
Re:We Used Broadband Data We Shouldn’t Have by weberc2 on Friday January 12, 2018 @01:00PM (#16134825)
I agree. This error has a pretty happy ending, but I think more political and ideological diversity in academia and journalism would help to spot these errors sooner and improve the overall quality of science and science journalism. In particular, in this case, a progressive research firm was trusted by academics who were trusted by journalists. Mistakes will happen regardless, but I wonder if a more skeptical eye somewhere in the pipeline would have caught this error sooner. Fortunately, there are bipartisan organizations like [Heterodox Academy][0] which are working to correct this.

[0]: https://heterodoxacademy.org

Re:We Used Broadband Data We Shouldn’t Have by throwawayjava on Friday January 12, 2018 @01:13PM (#16134936)
The major ISPs have a ridiculous amount of resources and are free to publish datasets answering this question at any moment. In fact, I'd be astounded if they don't already have this data, both for themselves and for their competitors. So until ISPs share that data, I'm terminally unsympathetic to any sort of bias in the public record on this particular topic.

Also, the selection of left-leaning people doing publicly accessible research is, AFAICT, a self-selection. The problem isn't that our institutions are biased, but that conservatives (in general) choose not to pursue scientific careers in the same numbers as liberals. This suggests a fundamental limit to your proposed solution because there aren't enough "heterodox" collaborators to ensure viewpoint diversity. One of the studies published on the website you mentioned even suggests this underlying cause.

Also, I'll note that in the vast majority of academia, internal politics (what research methodologies, maths, etc. someone likes to use) are far more of a problem than external politics (of the sort you'd typically call "politics" in general conversation). E.g. I'm not at all worried about "liberal bias" in physics or chemistry or CS; if it's a problem at all, then it's a minor one compared to other problems.

Re:We Used Broadband Data We Shouldn’t Have by PaulHoule on Friday January 12, 2018 @04:11PM (#16136340)
Very frequently people call up a broadband provider, get told there is broadband at their address, then they get told later that in fact it is not. Thus it's not clear that providers have a real handle on this at an operational level, never mind a synoptic level.

As for left v right, it's true that adjunct faculty who teach English are rabid leftists because they are working four jobs that are 60 miles apart, have no health insurance, qualify for food stamps, etc.

One reason you see so few rightists in conventional academia is that they can go work for places like the Manhattan Institute, Hoover Institution, etc. and get paid much more, not have to teach, not deal with the rat race. There is a continuous drumbeat of reports on how there is no broadband problem in the U.S. that is funded by the industry -- these don't get much attention outside the trade press because normal people know that students camp outside the school some nights because they don't have broadband at home.

Re:We Used Broadband Data We Shouldn’t Have by thaumaturgy on Friday January 12, 2018 @05:15PM (#16136815)
> ...people call up a broadband provider, get told there is broadband at their address, then they get told later that in fact it is not. Thus it's not clear that providers have a real handle on this at an operational level, never mind a synoptic level.

The provider (or the provider's CSR) is being lazy. They absolutely do have the data.

In AT&T's case, they have a Java software interface ("CPSOS") into which you can plug in an address and get back the distance in thousands of feet from the address to the nearest RT or CO (major network interconnection). The distance between those points gives you an estimate for the maximum DSL speed that can likely be supported; you can guarantee up to 6mpbs down at up to 5k feet if I remember right, and it tapers off from there to 10k feet, at which point you start saying, "we might be able to get you 512kbps but we're not sure, we'd have to try installing it and see what happens."

The sense you get, both as a consumer and as a service provider that gets a little more of an inside view into these companies, is that they absolutely do have the data and the capability, but that isn't where their priorities are. They just want to make a buck with as little capital investment as possible, and everything that they do reflects that.

Re:We Used Broadband Data We Shouldn’t Have by weberc2 on Friday January 12, 2018 @02:39PM (#16135640)
Whether or not the ISPs have this information is a fundamentally separate issue from whether ideological homogeneity biases science. There is no dichotomy here.

The degree to which self selection plays a role is an interesting question. Firstly, there is a certain amount of overt harassment--for example, professors in the humanities and social sciences openly admit that they would be inclined to reject a candidate if they knew he or she was conservative. Also there are lots of other data, anecdotal or quantitative. Much more is needed, however.

Importantly, the proportion of conservatives to liberals has been falling since the 90s, so something is driving the trend. It's also possible that conservatives are selecting out of a career that they (evidently correctly) perceive to be hostile to them or otherwise corrupt (more interested in furthering an agenda than seeking truth). The point is that even if it is self-selection, we may be able to improve the ratio enough to improve the science. And it's not like the ratio needs to be 50:50--probably 30:70 would suffice. Right now many fields are less than 10:90, and intuition suggests that the effect is nonlinear. If only 10% of faculty are conservative, intimidation causes them to suppress their already marginal voice, but 30% might be enough to allow them to feel secure in providing the sort of criticism those fields seem to desperately need. Of course, I'm picking on the academy, but the same probably holds true for journalism.

Again, the point isn't to assign blame, but to improve the science.

Re:We Used Broadband Data We Shouldn’t Have by throwawayjava on Friday January 12, 2018 @03:05PM (#16135872)
> Whether or not the ISPs have this information is a fundamentally separate issue from whether ideological homogeneity biases science. There is no dichotomy here.

I'm sort of making two only vaguely related claims here.

Claim 1: In this particular case, I don't think bias is even a problem, because we shouldn't even be doing this leg work on behalf of ISPs in the first place.

My point is that ISPs choose not to contribute to the quality of publicly available information. When entire industries (or governments) willfully hide data that's necessary for a populace to make an informed decision, I default to a worst-case assumption on that data. Not because I think that's most likely, but out of contempt for the lack of transparency and as a forcing function for greater transparency.

In other words, these "biased" researchers are already a hell of a lot more charitable toward the ISPs' position than I think we ought to be. If ISPs aren't willing to share granular data on network accessibility, then assume it's a major problem until they muster up the will to share that data.

>... the humanities and social sciences...

Claim 2: On this issue, I think it's helpful to discuss "critical studies" and related departments separately from the rest of "academia" and separately from the natural and mathematical sciences in particular. I don't think that the liberal bias in natural/math sciences has the same underlying causes OR the same long-term effects.

I.e., I don't think that chemistry departments are hiring based upon political beliefs, and I also don't think that political homogeneity effects the quality of chemistry research.

You also have to explain why political diversity is even important in the face of other forms of homogeneity. E.g., I'd rather a very liberal, very theoretical physics department hire a flaming liberal experimentalist than yet another theorist who happens to be conservative. The importance of political diversity in humanities and social sciences is obvious, but I don't see why science would suffer if all algebraists were libertarians...

My assertion is that if you want a politically diverse chemistry department, you have to 1) justify why that diversity is even necessary / more significant than other major problems; and then 2) probably also solve different underlying causes.

> Of course, I'm picking on the academy, but the same probably holds true for journalism.

And also literally every other profession, from clergy to CEOs to career criminals. There's even a trite quote about it.

Re:We Used Broadband Data We Shouldn’t Have by weberc2 on Friday January 12, 2018 @05:21PM (#16136863)
> Claim 1

I respect that your opinion is that ISPs have a social responsibility to disclose this information so think tanks and academies don't have to find it. I'm curious if anyone thought to ask them, but that's neither here nor there. I don't generally expect businesses to provide data apart beyond that which is required by law, but I'll concede the point since it's unrelated to my claims.

> Claim 2: On this issue, I think it's helpful to discuss "critical studies" and related departments separately from the rest of "academia" and separately from the natural and mathematical sciences in particular. I don't think that the liberal bias in natural/math sciences has the same underlying causes OR the same long-term effects.

I agree, and I intended to. I should have done better, but I quickly authored that comment from my phone in the waiting room at the vet clinic.

> You also have to explain why political diversity is even important in the face of other forms of homogeneity. E.g., I'd rather a very liberal, very theoretical physics department hire a flaming liberal experimentalist than yet another theorist who happens to be conservative. The importance of political diversity in humanities and social sciences is obvious, but I don't see why science would suffer if all algebraists were libertarians...

Again, I don't mean to apply my "political diversity" quip to apolitical fields.

> My assertion is that if you want a politically diverse chemistry department, you have to 1) justify why that diversity is even necessary / more significant than other major problems; and then 2) probably also solve different underlying causes.

I agree, and I don't think political diversity is important in chemistry, since few chemistry topics are politically polarized.

> "Of course, I'm picking on the academy, but the same probably holds true for journalism." And also literally every other profession, from clergy to CEOs to career criminals. There's even a trite quote about it.

Probably some degree of political diversity is good for all fields, but it's uniquely critical for politically polarized epistemological fields.

Re:We Used Broadband Data We Shouldn’t Have by jlardinois on Friday January 12, 2018 @03:55PM (#16136210)
Out of curiosity, what's the quote you mentioned?