News for hackers. Stuff that matters.
Re:Microsoft does away with stack ranking by Ensorceled on Tuesday November 12, 2013 @02:18PM (#6720177)
One major thing I learned from 360 reviews is how bad developers are at judging each other or their manager.

I've had employees on probation for lack of productivity judged as excellent by their peers because of their ability to socialize their "abilities". I had the best developer on my team (a 10x developer if ever there was one) get slammed on technical ability rankings because of his prickly personality.

My VP and I used have quite the chuckle at all my "strengths" identified by my team and peers ... because they liked me and I was effective they attributed positive characteristics to me that I did not have.

Re:Microsoft does away with stack ranking by lmg643 on Tuesday November 12, 2013 @02:50PM (#6720452)
I once had a similar experience - in an interview situation. (I can be likeable in person, just not in comments...)

The guy was attributing statements to me, from the conversation we were having in that moment, that i had never said. He would even say "what you said, or what you were going to say..."

I found it extremely bizarre. I am a pretty precise person, and I wanted to correct him but i realized it is pointless. the lesson i take away was powerful - if people "like" you there is almost no level they won't go to make it work out.

one thing we can do about this is cry about it. the other thing we can do is to figure out how to "hack" likability. i think my mother taught me most of the basics already.

of course - much easier to do this for one hour in an interview, than for an entire year at a job. but there is something to be said for smiling, a few kind words, and then ... graceful evasion of everything else when you want to do real work.

Re:Microsoft does away with stack ranking by 300bps on Tuesday November 12, 2013 @07:53PM (#6722600)
the other thing we can do is to figure out how to "hack" likability

Actually, the key to life is sincerity. Once you can fake that, you've got it made.

Re:Microsoft does away with stack ranking by gboudrias on Tuesday November 12, 2013 @10:24PM (#6723148)
Protip to all non-sociopaths: You can't fake sincerity. Trying will backfire in the long term.
Re:Microsoft does away with stack ranking by barry-cotter on Tuesday November 12, 2013 @11:03PM (#6723267)
Oh but you can. The unfortunate thing is that keeping on faking it, while possible, is very hard.

People's ideals generally move into conformity with their actions, not the other way round. That's one of the myriad reasons being a spy sucks. If anyone reading was following the police infiltration of left wing groups scandal in the UK, with added sex and dead babies identities the unit involved had a policy of only using married men after one guy never came back. Probably gone native.

Re:Microsoft does away with stack ranking by 300bps on Tuesday November 12, 2013 @10:33PM (#6723175)
Protip to all non-sociopaths: You can't fake sincerity. Trying will backfire in the long term.

You seem to know a lot about psychology. What do you call someone who doesn't recognize jokes?

Re:Microsoft does away with stack ranking by mynameishere on Tuesday November 12, 2013 @11:40PM (#6723386)
What do you call someone who posts ancient, moldy quotes?
Re:Microsoft does away with stack ranking by Aloha on Wednesday November 13, 2013 @03:37AM (#6724053)
How old are you guys, like 8?
Re:Microsoft does away with stack ranking by kabouseng on Wednesday November 13, 2013 @06:37AM (#6724558)
And even if your mother did not teach you much, you can get most of the lessons from "How to make friends and influence people" http://en.wikipedia.org/wiki/How_to_Win_Friends_and_Influenc...
Re:Microsoft does away with stack ranking by Daviey on Thursday November 14, 2013 @06:38AM (#6731767)
This book had a massive positive influence in my life. I'm glad I was introduced to it in my teens.
Re:Microsoft does away with stack ranking by kabouseng on Thursday November 14, 2013 @03:34PM (#6735340)
You're lucky, I'm 30 and only now started reading it... :D
Re:Microsoft does away with stack ranking by jredwards on Tuesday November 12, 2013 @03:46PM (#6720898)
Likability is underrated. Someone who is easy to work with, improves workplace morale, and makes other developers feel comfortable at work is a valuable asset. Certainly, it shouldn't be a substitute for technical ability, but it can be a very significant complimentary attribute.
Re:Microsoft does away with stack ranking by meowface on Tuesday November 12, 2013 @04:39PM (#6721375)
The problem is when likability affects how someone reviews your technical abilities. It should be a separate category, but most people would have significant trouble disassociating the two; more so if you're friends with a coworker.
Re:Microsoft does away with stack ranking by overgryphon on Tuesday November 12, 2013 @08:08PM (#6722670)
Is it so important that the individual components of a person's performance be evaluated individually? What about someone with exceptional technical abilities who uses those skills to ensure that blame for potential failure is always assigned to other people, rather than focus those impressive skills on the success of the overall project? Is it so important that person receive recognition for their technical skills?

If someone's social behavior jeopardizes the success of projects they work on, then perhaps it doesn't matter how technically competent they are.

Re:Microsoft does away with stack ranking by meowface on Wednesday November 13, 2013 @03:39AM (#6724061)
I understand your point, and I agree that cooperation, friendliness, humility, etc. are all extremely important skills in any engineer or developer, but I think there is some value in looking at the two things distinctly (technical and social).

As a counterexample to yours, what if someone is very friendly, witty, and amicable, but is severely lacking in technical skills? Perhas they are not even remotely pulling their weight in projects, resulting in friendly coworkers essentially doing their work for them and covering for them? In such a case you'll want to know that their technical skills are below what they should be.

Re:Microsoft does away with stack ranking by xymostech on Tuesday November 12, 2013 @08:36PM (#6722773)
The answer to your question is probably "no". However, most of the discussion was in reference to the stack ranking at Microsoft, where people's pay was being determined by how well they were ranked by their peers. If you were generally likable, people might also say that your coding skills were better than they really were. So, I think that you're right, and it's a good reason why the stack system didn't work very well.
Re:Microsoft does away with stack ranking by overgryphon on Wednesday November 13, 2013 @01:55PM (#6727455)
Except Microsoft doesn't stack rank people based on peer feedback- it's based on all the leads getting into a room and stack ranking their directs.

It's very possible to have a bad stack ranking but excellent peer feedback.

With this system, someone who delivers very well, but undermines other people or projects they work on would likely receive a high stack ranking, but poor peer feedback resulting in private discussions. People in charge of managing said employee may ignore the problem, attempt to place the employee under people who will help them address social problems, or quietly find a way to move them to a different org. It's quite likely none of this shows up in stack ranking.

Re:Microsoft does away with stack ranking by ekianjo on Wednesday November 13, 2013 @03:28AM (#6724022)
You can't dissociate parts of an individual just like you can't say that this part of the clock is so so but the alarm bell is great. What counts is the overall, if I may say holistic proposition of what you are evaluating. Does the person fit well in the team? Are they bringing value in one way or another ? It shouldn't be that important to evaluate the specific skills of a said person, but at least recognize what they achieved (or missed) and try to understand why, and then make a picture out of that. Likability cannot make up for actual results (or lack of), or at least not very long.
Re:Microsoft does away with stack ranking by Ensorceled on Tuesday November 12, 2013 @04:14PM (#6721165)
Agreed. Team work is critical, but likability should affect the soft rankings only but instead had an overall positive or negative effect, even on technical skill rankings.
Re:Microsoft does away with stack ranking by codeonfire on Wednesday November 13, 2013 @12:40AM (#6723574)
How would you feel about a team of only eminently likable people, none of whom could produce anything of value but all are very well liked, because this is the end game to rating likability.
Re:Microsoft does away with stack ranking by YZF on Tuesday November 12, 2013 @02:48PM (#6720428)
360 isn't perfect but it's better than the alternative.

You're basically saying that those who worked daily in close interaction with the 10x developer and had to work with the code that developer produced, had lower regard for his technical ability than a manager who presumably is further removed?

You can't ignore the social aspect. A team with social frictions isn't going to work as well as a team that enjoys working together. Obviously just being social isn't enough but a strong team needs a combination of the social and technical aspects. Also 360 should mean going beyond the team, so the manager should be evaluated by his peers, his managers and his team and technical people on the team should be evaluated by members of other teams they work with.

Re:Microsoft does away with stack ranking by Ensorceled on Tuesday November 12, 2013 @04:25PM (#6721257)
Yes, I know what a 360 is, I've participated in them.

In the situations I indicated I was also a developer on the team so I knew how productive and skilled the 10x prickly developer was. His peers ranked him high on technical skills but only as high as more amicable and lessor skilled peers.

I'm not saying I ignored the social aspect, in fact that is why I called him "prickly". I'm just saying that, while his teamwork related areas were properly low, his technical areas were improperly low because of this halo effect.

Re:Microsoft does away with stack ranking by specialist on Tuesday November 12, 2013 @07:10PM (#6722398)
Did you manage a self-selected team?

I swiped the Roman Evaluation Method from Luke Hohmann. During interviews, a No from one is a No from all. Self selecting teams is one of those agile advices.

If your prickly superstar was chosen collectively, he would have been given a lot of latitude. Eyes wide open kinda thing.

The only sticky interpersonal problems I've had is when some higher ranking genius assigns people to my teams, mostly unwanted and unwelcome.

And sometimes just plan bad soup. People good individually, bad together. Like when the boss assigned an outspoken Lebonese and an outspoken Israeli to my team. They got along as well as peanut butter and lug nuts.

Re:Microsoft does away with stack ranking by gtirloni on Wednesday November 13, 2013 @09:09AM (#6725195)
Self-selected teams while good from that perspective actually have a huge downside: politics and pleasing your friends.

Next thing that happens is people start choosing members based on how much comfortable they are (which doesn't translate into technical skills and delivering stuff) or start talking to each other, trying to convince people.. this sucks!

While it might work for small companies with not much variation in technical skills and sociability between employees.. for anything else it's kinda hard.

Plus, that initial list of 2-3 employees that start talking and picking others was selected by someone, wasn't it? And the list that they can pick from was also selected, no?

I think if you need a team of 10 and you have 30 possibly good candidates within your company (and they are all available to move to your team).. sure, why not. You as a manager already pre-selects a bunch of people and then let your team members filter it even further.

But putting that responsibility from the beginning solely on the team members.. I guess that's risky. But anyway, how often does that happen?

If we are talking about selecting 1-2 people for a already formed team than fine.. of course other team members should do it (but that's mostly the norm in a lot of companies.. the manager/tech lead runs the resumes through people he/she trusts, ask them to participate in interviews.. no big difference there).

Re:Microsoft does away with stack ranking by munificent on Tuesday November 12, 2013 @08:01PM (#6722635)
> I knew how productive and skilled the 10x prickly developer was

How? What makes you so sure you weren't biased?

Re:Microsoft does away with stack ranking by Ensorceled on Tuesday November 12, 2013 @10:26PM (#6723156)
Well, I certainly am biased, in a way I'm probably not aware of :-)

How? He wrote a ton of great code in a short period of time that worked amazingly well. How else would you tell somebody was productive and skilled?

But, think whatever you want!

Re:Microsoft does away with stack ranking by dreamfactory on Tuesday November 12, 2013 @05:23PM (#6721719)
Makes me wonder if he wasn't a prolific tech debt producer who was seen by management to GTD.
Re:Microsoft does away with stack ranking by Ensorceled on Wednesday November 13, 2013 @12:01AM (#6723451)
No, but I know exactly what you mean. Years ago I was on a team where the "super star" was assigned all new work. The rest of us had to fix the bugs in their code.

At the finale, 5 people were doing nothing but fixing bugs in the "stars" previous projects. That's when senior management finally clued in to the problem and fired both the manager and the "super star".

Re:Microsoft does away with stack ranking by dreamfactory on Wednesday November 13, 2013 @09:38AM (#6725390)
going by the upvotes, we aren't the only people to have seen this anti-pattern...
Re:Microsoft does away with stack ranking by Ensorceled on Wednesday November 13, 2013 @10:51AM (#6725950)
Yeah, this is why I kind of like project ownership even though it's now considered out of fashion. If you create technical debt, you own it and it's your future productivity that takes the hit. Eventually your productivity grinds to a halt as you fix problems in the crap you wrote before.
Re:Microsoft does away with stack ranking by dreamfactory on Wednesday November 13, 2013 @07:35PM (#6729712)
I look at it as technically informed product ownership - merging business and technical domain knowledge to make the right tradeoffs. How else can you execute effectively?
Re:Microsoft does away with stack ranking by ddoolin on Tuesday November 12, 2013 @02:30PM (#6720271)
I've always been highly sociable compared to my other coworkers and have also noticed I get attributed things that weren't really accurate. Notably non-technical coworkers seem to think I work at break-neck pace when I really just work at pace with everyone else, most likely because I actually talk about what I'm doing with them more often.
Re:Microsoft does away with stack ranking by tensor on Tuesday November 12, 2013 @03:19PM (#6720661)
What makes you think that your judgements are any better than theirs? How do you judge performance? Do you look at code? Or do you simply go by how many feature check boxes they get through in a given time frame?

edit: and I don't ask this to be insulting, but judging performance is a very difficult task and I've never seen a reliable methodology for doing it. Thus, I'm naturally extremely skeptical when someone claims that they can do it better than others. Especially so when it includes broad generalizations about a group of people.

Re:Microsoft does away with stack ranking by Ensorceled on Tuesday November 12, 2013 @04:20PM (#6721209)
I'm usually one of the strongest developers on my team, even when I'm managing. It's one of my strengths and why I stay with small companies. It also means I'm qualified to judge the technical skills of my developers, I know how long it should take.

People who think judging performance is hard have a broken development methodology or no technical chops.

That's also why I included the comment on my own rankings; I have some pretty serious weaknesses that were ranked as areas of strengths by my peers and reports.

Re:Microsoft does away with stack ranking by tensor on Tuesday November 12, 2013 @05:00PM (#6721533)
>People who think judging performance is hard have a broken development methodology or no technical chops.

And this is exactly why I asked the question. Here you have judged me, since I said judging performance was hard, on both my development methodology and technical chops. Yet you know nothing about me at all.

The problem of evaluation is an important one, and one I'm always interested in reading more on. Unfortunately the strategy of taking one's self as a gold standard isn't exactly what I was looking for. It does seem obvious that being an expert in your domain is a necessary trait to be able to evaluate others, but it's not at all obvious that it is a sufficient trait.

The idea of multi-source feedback seems intuitively good, despite the conflicting research on it. That more input will expose biases or inaccuracies is a decent hypothesis. On the other hand, judgment from a single person seems highly error prone. Whatever faults that one person has will never be exposed and reviews seem almost guaranteed to have bias.

In the end, I'm left with no idea why you so quickly discard the reports of your peers.

Re:Microsoft does away with stack ranking by Ensorceled on Tuesday November 12, 2013 @05:31PM (#6721801)
In fairness, you judged me first.

I've never had a problem judging performance when I was doing my job right. Any time I've been unsure it's because I was either not managing the team properly or did not have enough technical knowledge to evaluate the estimates and claims (e.g. this took longer because of X and Y).

I know you can manage performance in a way that allows evaluation even if you don't have the technical chops to evaluate it technically, because I have seen technically weak peers do a good job of it.

I didn't discard the reports of my peers. I noticed a trend of the peers who liked me rating me higher in areas of weakness (as perceived by both myself and my boss) than my skills deserved.

Data that contains some bias is not useless if you can adjust for the bias.

Re:Microsoft does away with stack ranking by Iftheshoefits on Tuesday November 12, 2013 @08:50PM (#6722808)
Most managers are unable to adjust for their own biases, though.

I'm especially skeptical of managers who evaluate themselves as having above average technical ability after they have asserted how poorly most people evaluate their peers. The necessary conclusion of such an assertion is that people therefore haven't a rational basis on which to judge their own skills relative to others.

Re:Microsoft does away with stack ranking by Ensorceled on Tuesday November 12, 2013 @10:02PM (#6723063)
Ummmm, sure. Are you always this aggressive of an ass?
Re:Microsoft does away with stack ranking by jmmcd on Wednesday November 13, 2013 @07:45AM (#6724826)
> I've never had a problem judging performance when I was doing my job right. Any time I've been unsure

It's not what you don't know that hurts you. It's what you know that just ain't so.

Re:Microsoft does away with stack ranking by JSZZHlmumeUE on Tuesday November 12, 2013 @09:30PM (#6722961)
People who think judging performance is hard have a broken development methodology or no technical chops.

I suggest you reflect on this. It seems to me that you've convinced yourself that you are good at certain things but there isn't really any evidence supporting your beliefs.

When I was younger, I actually used to think like you - that perf evaluation is easy and a good engineer (e.g. me) would be able to evaluate others easily. Over time, I've realized this is an incredibly complex and nuanced issue because everyone's strengths and weaknesses are so very multifaceted. I am more or less convinced that people who think they have all the right answers simply have a lot of blindspots.

Re:Microsoft does away with stack ranking by Ensorceled on Tuesday November 12, 2013 @11:56PM (#6723431)
I've been managing teams for more than 20 years. Performance evaluation is easy, somebody is either performing well or they are not and a good manager can tell. One of the reason I like Agile is that if it's done right, the whole team can tell who isn't performing.

Performance analysis is incredibly complex and nuanced. Judging if somebody is performing poorly because they are unskilled or not managed properly or having marital problems is hard. Improving performance is even more difficult because it requires the analysis and a remediation plan.

Re:Microsoft does away with stack ranking by SnacksOnAPlane on Wednesday November 13, 2013 @12:00AM (#6723449)
This kind of thinking throws me into infinite loops. I think I'm not such a good developer, which makes me think that I must be a good developer because I recognize my limitations, which makes me think that I'm not such a good developer because I think I'm a good developer, and so on.
Re:Microsoft does away with stack ranking by Ensorceled on Wednesday November 13, 2013 @10:56AM (#6725988)
HN has a real problem with people who self identify as good programmers ... there is always a bunch of "no you're not" and "you only think you are" and "people who say they are good usually suck" type of responses. It's pretty weird reaction for a tech site where many good programmers hang out.
Re:Microsoft does away with stack ranking by SubuSS on Wednesday November 13, 2013 @12:34PM (#6726790)
The problem is companies are looking for engineers while you are talking about this in terms of programmers. In most companies, it is about shipping and making a difference to the bottom line. It doesn't really matter if you are a good programmer if you are not getting things out of the door / ensuring future dev/maintenance will be pain free. For this programming is a tool, just like planning / estimation / design skills / being likable which helps with mentoring new developers etc. The % might differ, but the net evaluation has to be on the whole. Net results are also based on the big picture - what is your impact on the product? If we go by programming abilities alone, then managers must make base pay, which they don't. Also as you grow senior, the requirements change too.

And I don't know your scale of 'good' programmer either: What do you mean by that? Are you saying you are as good as Linus Torvalds or are you saying you are better than your current peers? I am assuming it is the latter - which probably means zilch in a site like this. Many folks here receive that recognition and over time they come to a conclusion that it doesn't mean much. Which is why you get a lot of naysayers. They aren't doubting you, they are just doubting the general feeling as been there, done that.

Re:Microsoft does away with stack ranking by Ensorceled on Wednesday November 13, 2013 @02:10PM (#6727573)
I don't think that is it. If you self identify as a good engineer/developer/progammer you get the same response. It's the self identifying thing that's seems to be the problem.

Look at this thread, there are several who are very explicitly doubting me in no uncertain terms. Even doubting the idea that I'm good compared to my current peers.

Re:Microsoft does away with stack ranking by tiglionabbit on Tuesday November 12, 2013 @03:56PM (#6720990)
This is a perfect description of the Halo Effect.

http://en.wikipedia.org/wiki/Halo_effect

Re:Microsoft does away with stack ranking by HelloMcFly on Tuesday November 12, 2013 @04:08PM (#6721115)
It's a good description that goes in both directions. 360 reviews are popular because they reduce single-source bias (a subclass of Common Method Variance). Different perspective of an employee can helps account for unique variance in the employees' true performance. From my perspective Ensorceled's comment demonstrate their value rather than their shortcomings.
Re:Microsoft does away with stack ranking by Ensorceled on Tuesday November 12, 2013 @04:27PM (#6721276)
Exactly! I love 360 reviews because, in part, they help mitigate the halo effect. They were also good at revealing the halo effect.
Re:Microsoft does away with stack ranking by michaelt on Tuesday November 12, 2013 @06:20PM (#6722153)
What's the point of doing a 360 review if you're going to attribute away all the results you don't agree with to bias? Why not just do the reviews yourself and save everyone else from wasting their time :)
Re:Microsoft does away with stack ranking by Ensorceled on Tuesday November 12, 2013 @10:09PM (#6723090)
I'm not sure why everybody is assuming I toss all of these reviews. They are not useless even when biased.

The reason you do 360's is that you have to take every individual review with a grain of salt. When you have 7-10 reviews the biases start to average out.

Re:Microsoft does away with stack ranking by kabouseng on Wednesday November 13, 2013 @06:34AM (#6724545)
Thats a fair comment, but in a similar vein; do you trust your own ability (as manager I presume) to evaluate the work output and business value of the employees? Or otherwise do you trust a / your manager with this?

One thing that is true, is often times the manager has more information about the various reasons for certain choices and goings on in the business, and thus is in a better position to evaluate people.

The question then is just, how do you make sure that manager do not discriminate based on soft indicators (personalities match / clashes / favouritism etc.).

Re:Microsoft does away with stack ranking by mathattack on Wednesday November 13, 2013 @11:20AM (#6726197)
It's very hard to separate emotional liking of people with being able to rate their abilities, since rating for most white collar jobs is so subjective. This is why forced stacking can be so insidious, and also why ratings frequently seem unfair. It's also why office politics creep in to the process. People trade on their likeability because they're not confident that their skills will be properly weighted.