News for hackers. Stuff that matters.
Re:Study shows salaries of young women 8% higher than men in... by fwdpropaganda on Tuesday April 03, 2018 @06:59AM (#16743456)
> Sadly "equal pay" means whatever you want it to mean.

Exactly this. At a fundamental level every individual has an infinite number of "dimensions" (in ML parlance) associated with him, and "equal pay" people or groups will try and convince you that expected pay should be the same over a certain subset of dimensions while ignoring all the others. Invariably they will pick the most beneficial to that particular person or influence group. They will give you arguments from moral, while forgetting to mention that like in any midly complex problem, data bias and confounding variables are of paramount importance.

So "equal pay" means whatever you want it to mean because try and you may, you will never have a model with the full infinite set of dimensions that the real world has. Having to pick you pick the ones you want, a choice that others will attack.

Re:Study shows salaries of young women 8% higher than men in... by jwfxpr on Tuesday April 03, 2018 @07:51AM (#16743751)
You cannot dismiss rigorous statistical analysis by arguing it can never encompass the full dimensions of the data. Of course it can't. The map is not the territory; it is a useful way to find our way around it. Ignoring the map is perilous, if not arrogant, even though it is merely a flawed representation of the real truth.

You might argue that a specific study or meta-analysis contains a bias or misinterpretation, but only if you've actually examined their methodology, data, and reasoning. You cannot argue that all studies of complex topics are invalid simply because their topics are complex.

Re:Study shows salaries of young women 8% higher than men in... by tomp on Tuesday April 03, 2018 @09:22AM (#16744358)
> You cannot dismiss rigorous statistical analysis by arguing it can never encompass the full dimensions of the data.

This simply means it's not rigorous. See Omitted-variable bias - from [1]: The bias results in the model attributing the effect of the missing variables to the estimated effects of the included variables. For example, including gender but not education or hours worked will result in attributing pay differences to gender, but including all relevant variables shows that's gender is irrelevant.

https://en.wikipedia.org/wiki/Omitted-variable_bias

Re:Study shows salaries of young women 8% higher than men in... by dwaltrip on Tuesday April 03, 2018 @10:19AM (#16744819)
You entirely missed the point. We can never include every single relevant variable to perfectly explain the observation. It's impossible.

This doesn't mean statistics is useless.

This is the meaning of the phrase "the map is not the territory". All models are flawed, but some are useful.

Re:Study shows salaries of young women 8% higher than men in... by mseebach on Tuesday April 03, 2018 @10:50AM (#16745139)
No, statistics aren't useless, but its usefulness cuts both ways: if you can add one or two relevant variables and almost entirely remove the observation, then statistics tells you that the observation was only there due to omitted-variable bias.
Re:Study shows salaries of young women 8% higher than men in... by dwaltrip on Tuesday April 03, 2018 @03:22PM (#16748179)
Sure, that's fine. That's part of using statistics to the best of our ability.
Re:Study shows salaries of young women 8% higher than men in... by fwdpropaganda on Tuesday April 03, 2018 @10:23AM (#16744867)
I think there's some middle ground between saying that the analysis is rigorous and saying it's useless, no?
Re:Study shows salaries of young women 8% higher than men in... by dwaltrip on Tuesday April 03, 2018 @10:35AM (#16744996)
Indeed. But that's where all the hard work is -- trying to determine how rigorous something is, knowing it certainly isn't perfectly rigorous.
Re:Study shows salaries of young women 8% higher than men in... by PurpleBoxDragon on Tuesday April 03, 2018 @09:59AM (#16744625)
>You cannot argue that all studies of complex topics are invalid simply because their topics are complex.

If you take a random sample of studies you can make a statistical analysis. You don't need to examine every cow to make an argument that there are no pink cows, but you do need to do a random sample. And that's if you only want to meet the highest standards of evidence. Much lower standards can be far easier to meet.

Re:Study shows salaries of young women 8% higher than men in... by fwdpropaganda on Tuesday April 03, 2018 @10:55AM (#16745179)
> If you take a random sample of studies you can make a statistical analysis. You don't need to examine every cow to make an argument that there are no pink cows, but you do need to do a random sample. And that's if you only want to meet the highest standards of evidence. Much lower standards can be far easier to meet.

Your comparison of this problem with pink cows shows that you haven't given it two seconds thought. Estimating the number of pink cows in the world is a very simple problem. Determining pay gap is a very very complex problem that starts with defining what the question really is and associated fights between different interest groups which might prefer one or another definition, then goes on to the (social, privacy, and rights) problem of obtaining the data, and moving on into with the data analysis itself which is just hellish if you want to have any semblance of rigour, and finally policy take aways from the analysis which hinges crucially on how you defined the question initially.

Stop adding to the noise please.

Re:Study shows salaries of young women 8% higher than men in... by PurpleBoxDragon on Tuesday April 03, 2018 @04:04PM (#16748568)
>Estimating the number of pink cows in the world is a very simple problem.

If by 'estimating' you mean a scientific study that tries to answer the question, then it isn't simple at all. First we need a rigorous definition of pink cows. If I dye my cow pink, does that count? What if other people don't agree with my definition? A pig whose skin is pink is considered pink, so should I only rely on hair color? And what counts as pink? Are we only going with stereotypical hot pink? There is a red cow, but it is a really brownish red. Would a brownish pink be enough to qualify as a pink cow?

So once we solved all those problems, we need to come up with a methodology, and it likely won't be the same everywhere. We could make the problem a lot simpler by reducing our search space to say, only cows on ranches in the state of Montana. But to do a global sampling isn't easy.

>associated fights between different interest groups which might prefer one or another definition

To my knowledge (and with no peer reviewed research to back up my view), there is no groups who have a political stake in what counts as a pink cow. So for that reason it is simpler because there aren't political complications.

But you seem to be confusing something. You appear to be talking about studying wage gap. I was talking about studying studies of wage gaps.

So for my plan, it would work like this:

Taking all the studies of wage gap in the last n years, pick x at random. For each of these, determine if each one does or does not account for some factor that impacts pay regardless of gender (say height of employee). You can then compute what percentage of studies took this factor into account.

Then you repeat this with a few other factors, each time repicking the studies investigated. From those percentages, you can determine how often your selection of factors are taken into account, and from that you might be able to make the argument that the data is biased enough to not be usable.

Re:Study shows salaries of young women 8% higher than men in... by dominotw on Tuesday April 03, 2018 @11:10AM (#16745370)
Isn't that why we have 'replication crisis' in fields that 'can never encompass the full dimensions of the data'

Doesn't replication crisis prove 'that all studies of complex topics are invalid simply because their topics are complex.'

Re:Study shows salaries of young women 8% higher than men in... by boomboomsubban on Tuesday April 03, 2018 @11:50AM (#16745840)
Science as a whole has developed knowing that it is impossible to encompass the full dimensions of the data, the goal is to find the best explanation given the available evidence.

The replication crisis is a result of the misuse or misunderstanding of the statistics, and the current nature of journals.

Re:Study shows salaries of young women 8% higher than men in... by stdbrouw on Tuesday April 03, 2018 @07:07AM (#16743488)
A heuristic in which you refuse to undertake any action without complete information of perfect reliability is always biased towards the status quo. Heck, it's straight from the CIA Simple Sabotage Field Manual. So in the guise of "first needing to understand the complexities of the problem", you are rationalizing away the preponderance of evidence which shows that, yep, any way you cut it, there's a gender wage gap.
Re:Study shows salaries of young women 8% higher than men in... by fwdpropaganda on Tuesday April 03, 2018 @08:36AM (#16744015)
> A heuristic in which you refuse to undertake any action without complete information of perfect reliability is always biased towards the status quo.

I agree with that phrase, and I acknowledge that it's a problem, but you're jumping into conclusions about what I was trying to say. I wasn't trying to say "we don't have complete information, so we should do nothing." Read on:

> you are rationalizing away the preponderance of evidence which shows that, yep, any way you cut it, there's a gender wage gap.

No, that's is precisely my point. It is NOT true that any way you cut it there's a gender gap. If you let me cut it how I want it I can have the gap be anything I want by carefully (as an example) picking which of the omitted variables I adjust for sampling bias and which ones I don't[0]. That is what I was trying to say.

[0] And lets not talk about confounding variables, that problem is at least an order of magnitud harder even than sampling/population bias.

Re:Study shows salaries of young women 8% higher than men in... by ada1981 on Tuesday April 03, 2018 @10:51AM (#16745141)
In case anyone needs a PDF of the CIA Simple Sabotage Field Manual

https://www.cia.gov/news-information/featured-story-archive/...

Re:Study shows salaries of young women 8% higher than men in... by kristianc on Tuesday April 03, 2018 @07:11AM (#16743508)
> Exactly this. At a fundamental level every individual has an infinite number of "dimensions" (in ML parlance) associated with him, and "equal pay" people or groups will try and convince you that expected pay should be the same over a certain subset of dimensions while ignoring all the others.

Surely the right response to a study which challenges your existing worldview would be "Hmm, that's interesting - I wonder what is driving that?" rather than "The equal pay people or groups will always try to convince you..."

Re:Study shows salaries of young women 8% higher than men in... by mseebach on Tuesday April 03, 2018 @07:18AM (#16743558)
It seems that GP did that, and learned that these studies ignore inconvenient factors.
Re:Study shows salaries of young women 8% higher than men in... by mcny on Tuesday April 03, 2018 @07:26AM (#16743600)
What we should mandate is transparency. We all think we are expert negotiators but we are all idiots. We will all be better off if all salary and all compensation information is public and easily accessible. Sadly, a lot of people think they have something to lose and will never support it.
Re:Study shows salaries of young women 8% higher than men in... by crusso on Tuesday April 03, 2018 @09:39AM (#16744474)
It would be an interesting experiment. Has it been done before? That could lead to some unpleasant things:

    * A lot of unavoidable angst as people of less worth to the business are proven to be paid less in no uncertain terms.
    * More internal strife as people jockey for identifiable rank within the organization based upon their salaries.  "Why is Sue paid $10k more than I am?  Sue wasn't at her desk all week last week while I was here busting my butt."
    * Eventually, many managers and organizations would just sidestep the battle by paying everyone the same thing based upon easy-to-identify metrics like seniority.  As a result, the people with more value to the business will find jobs at companies that pay them according to a better measure of their bottom-line worth.  With no one left but the lowest-common-denominator employees, the company flounders and fails.
Re:Study shows salaries of young women 8% higher than men in... by majormajor on Tuesday April 03, 2018 @01:11PM (#16746824)
> Eventually, many managers and organizations would just sidestep the battle by paying everyone the same thing based upon easy-to-identify metrics like seniority. As a result, the people with more value to the business will find jobs at companies that pay them according to a better measure of their bottom-line worth. With no one left but the lowest-common-denominator employees, the company flounders and fails.

In most fields, there are already companies which pay wildly different amounts for the same jobs, so the people contributing more in those similar roles are already highly incentivized to leave for higher-paying pastures.

Re:Study shows salaries of young women 8% higher than men in... by fyi1183 on Tuesday April 03, 2018 @09:57AM (#16744603)
In certain Nordic countries (Sweden at least, I believe), all tax data is public. By extension, everybody's income is public as well. It doesn't seem to be an issue.
Re:Study shows salaries of young women 8% higher than men in... by crusso on Tuesday April 03, 2018 @10:23AM (#16744868)
A quick Google turned up some refutation of your statement:

https://news.ycombinator.com/item?id=9907147

Looking further, it appears that Sweden has decreased the amount of transparency by requiring that people make specific requests that notify the taxpayer of the request.

http://www.businessinsider.com/sweden-salaries-freely-availa...

Apparently, there were issues. I'd like to see this experiment run for a longer period of time in more culturally diverse environments, though.

Re:Study shows salaries of young women 8% higher than men in... by dingo_bat on Tuesday April 03, 2018 @07:34AM (#16743653)
I don't want my salary to be transparent. There is something called privacy. My salary is a private matter. I really don't believe I'm any kind of expert in negotiation.
Re:Study shows salaries of young women 8% higher than men in... by oblio on Tuesday April 03, 2018 @08:07AM (#16743844)
His point is that your need for privacy is preventing group wins. You want to avoid a bit of shame or envy but by making this decision we, as employees, lose a lot of our leverage.

You wouldn’t have to negotiate a better salary if it would be obvious that you are underpaid.

Re:Study shows salaries of young women 8% higher than men in... by sokoloff on Tuesday April 03, 2018 @08:15AM (#16743886)
I think a "fair" distribution of pay for software engineers would more unequal than it is currently. (This is the logical financial conclusion of believing in the 3x, if not 10x, engineer, which I do.)

I have people who work on my teams who are absolutely fantastic and, while already well-paid, probably should make more. I have other people on my team, with the same title, same education, same on-paper responsibilities, same city, same years of experience, who might be below the median pay and are still overpaid based on my estimation of their contributions relative to their peers.

You can't look only at a spreadsheet and determine that it's "obvious that you are underpaid", IMO.

Re:Study shows salaries of young women 8% higher than men in... by oblio on Tuesday April 03, 2018 @08:55AM (#16744163)
That only works the way you think it works if most people agree with you. I doubt that... Plus it's really hard to determine who is actually a 10x contributor, even more so universally (across projects, teams, companies).
Re:Study shows salaries of young women 8% higher than men in... by majormajor on Tuesday April 03, 2018 @01:14PM (#16746850)
It's really not that hard to see, on a single team, who's contributing twice as much as who else. You don't even have to be a manager - sometimes managers are the last to be sure, actually. Generally people who complain about lazy coworkers end up settling on a lot of the same people... Being a manager just gives you official venues like feedback requests to realize "oh everyone else sees it too."
Re:Study shows salaries of young women 8% higher than men in... by crdoconnor on Tuesday April 03, 2018 @02:40PM (#16747768)
Managers are usually terrible at knowing who is contributing on a software team and they're the ones who set pay.

This is 100% a red herring as far as pay transparency is concerned anyway. If you're not being unfair you have no reason to hide anything.

Re:Study shows salaries of young women 8% higher than men in... by ameister14 on Tuesday April 03, 2018 @10:51AM (#16745150)
It would also prevent raises.
Re:Study shows salaries of young women 8% higher than men in... by oblio on Tuesday April 03, 2018 @11:13AM (#16745403)
You're assuming that I'm a world were transparency goes up, good negotiators go extinct? :)
Re:Study shows salaries of young women 8% higher than men in... by ameister14 on Tuesday April 03, 2018 @11:36AM (#16745659)
Logically, if I know that in giving one person a raise, everyone will ask for the same raise, I just won't give anyone a raise that isn't negotiated by the entire group, which takes longer and is less likely to occur without conflict.

It actually extends to the whole market, too - if all salaries are transparent, then an RN makes x. They can't make more than that, anywhere they go. It gives a floor, sure - if they get hired, they'll get paid the same as everyone else; it just also makes a ceiling, and, I believe, may slow income growth in general.

Re:Study shows salaries of young women 8% higher than men in... by oblio on Tuesday April 03, 2018 @12:06PM (#16746054)
Salary growth for the past 30 years has been slower than productivity growth.

So I'd see your point as already happening, companies have already capped salaries, except for executives, who basically set their own salaries.

Re:Study shows salaries of young women 8% higher than men in... by briandear on Tuesday April 03, 2018 @02:16PM (#16747507)
However consumer prices have gone down over the same period. A refrigerator today costs much less in terms of labor hours than it did 30 years ago. So productivity growth has led to a rise in living standards.
Re:Study shows salaries of young women 8% higher than men in... by knightofmars on Tuesday April 03, 2018 @03:20PM (#16748156)
> So productivity growth has led to a rise in living standards.

I love seeing this statement. It's true but the people who post it never follow up evaluating whether or not productivity growth has far out-paced the rise in living standards. If productivity growth has been exponential while the rise in living standards has been linear that's a sign that there's a problem regardless of whether or not living standards have risen.

Re:Study shows salaries of young women 8% higher than men in... by dingo_bat on Tuesday April 03, 2018 @09:05PM (#16750970)
No the assumption is that a good negotiator now has to negotiate for everyone. Because if you give a raise to him, others will come to know and ask for similar treatment.
Re:Study shows salaries of young women 8% higher than men in... by jabot on Tuesday April 03, 2018 @11:46AM (#16745782)
> I really don't believe I'm any kind of expert in negotiation.

That means that transparency works _for_ you, not against you.

Re:Study shows salaries of young women 8% higher than men in... by dingo_bat on Tuesday April 03, 2018 @12:01PM (#16745984)
But that doesn't mean I'm ready to give up my privacy.
Re:Study shows salaries of young women 8% higher than men in... by mcny on Wednesday April 04, 2018 @06:26AM (#16753452)
That is exactly what they want us to think. I'm glad you at least realize there is information asymmetry at play here. Thank you for keeping an open mind. You have come farther than many people I've talked to. We can get there.
Re:Study shows salaries of young women 8% higher than men in... by everyone on Tuesday April 03, 2018 @09:28AM (#16744387)
Why? What benefit does that entail? Is is greater than the benefits of transparency?
Re:Study shows salaries of young women 8% higher than men in... by dingo_bat on Tuesday April 03, 2018 @09:09PM (#16750990)
Yes. My privacy is not a trivial matter.

Think of it like this. Will you be willing to post your entire web browsing history to a publicly available archive regularly? It will help prevent a lot of illegal activity if everyone agreed to do that.

Re:Study shows salaries of young women 8% higher than men in... by LanceH on Tuesday April 03, 2018 @09:01AM (#16744213)
But the bar -- as established by the 77% number -- is that a difference in pay is sexism.
Re:Study shows salaries of young women 8% higher than men in... by mistermann on Tuesday April 03, 2018 @10:25AM (#16744886)
> Exactly this. At a fundamental level every individual has an infinite number of "dimensions" (in ML parlance) associated with him

And of course, this applies not just to people but to most complex entities or ideas. The problem is, when dealing with humans, even intelligent ones, good luck getting them accept this approach when it interferes with their political/emotional/fiscal beliefs or desires. For reference, see recent discussions here on topics like trade tariffs.

Re:Study shows salaries of young women 8% higher than men in... by fouc on Tuesday April 03, 2018 @09:36AM (#16744453)
We can use bayesian inference here to update the probability of equal pay as more dimensions are added.