News for hackers. Stuff that matters.
Re:U.S. regulators accuse Palantir of bias against Asians by throwaway8976 on Monday September 26, 2016 @07:35PM (#12586510)
I worked at Palantir in the covered period and did a ton of interviews, 5-10 a week. I experienced exactly this dynamic - very large numbers of applicants who had a bachelor's degree from a South or East Asian university, a year or two of work experience, and a Masters from a mid-tier US University. The large majority washed out on the FizzBuzz-level technical questions on phone screens (or asked in person at job fairs).
Re:U.S. regulators accuse Palantir of bias against Asians by ChuckMcM on Monday September 26, 2016 @08:47PM (#12586822)
If that is the case, and the records show that, then the company is probably ok. But you have to show that all of the people you hired could pass FizzBuzz right? Google gave one of the best hiring training lectures I've ever attended on eliminating personal bias from interviewing questions. A lot of it was thinking about the question and the response and putting it in the context of someone you knew, what would you think then? Would you still consider it so highly? Or as such a deficit? They said, although I didn't experience it directly, that they did data analytics on interviewer write ups to identify bias. That could have been to sort of encourage due diligence but given how data driven that company was when I was there I would not put it past them to do exactly that.
Re:U.S. regulators accuse Palantir of bias against Asians by ng12 on Monday September 26, 2016 @09:43PM (#12586981)
How does personal bias factor in to FizzBuzz? It's literally what I'm hiring you for -- I should be able to describe some process to you, and you should be able to write it out in code. Communication is a huge part of software engineering, and I don't understand why anyone would be expected to hire employees they cannot communicate with.
Re:U.S. regulators accuse Palantir of bias against Asians by ChuckMcM on Monday September 26, 2016 @10:43PM (#12587156)
In addition to vidarh's excellent response, FizzBuzz is a great example that personal bias should not interfere. So if you did data analysis of your candidates and everyone you hired could do FizzBuzz and everyone you didn't hire could not do FizzBuzz then you could objectively state that failure to do FizzBuzz disqualified the candidates and it was blind to personal bias or discrimination factors. However if you hire whites who couldn't do FizzBuzz in the interview and you didn't hire asians who could, then you can't really say that "not being able to do fizzbuzz is a disqualifier" because it only disqualified some candidates.

Generally if you are hiring on work product skills (coding for software folks) and can show that your test is unbiased and you hire to the test, then you can avoid being found guilty of discrimination even if you hire a disproportionate number of a certain group. To be rock solid you also need to show that your applicant pool is highly diversified and has representation from all groups. Sometimes that means going out and seeking out candidates (like women or hispanics) who are self selecting to not apply. And why you really do better if you blind the resumes your HR staff sees before they sort them into phone screen and skip piles.

Re:U.S. regulators accuse Palantir of bias against Asians by morgante on Tuesday September 27, 2016 @03:30AM (#12587975)
> However if you hire whites who couldn't do FizzBuzz in the interview and you didn't hire asians who could, then you can't really say that "not being able to do fizzbuzz is a disqualifier" because it only disqualified some candidates.

This is a great point and it's why I always include FizzBuzz in any interview—no matter how they were referred, how impressive their resume is, or their confidence level.

Having consistent benchmarks helps give you legal cover, but it's also essential to running a solid interview process. If you're not applying the same tests to all candidates, it's impossible to detect problems in your filters and you can easily end up making biased decisions or hiring the wrong people.

Yes, I understand that it can be annoying to have to solve such a basic problem in an interview, but it only takes a few minutes—just get it over with, it's not meant as an insult.

Re:U.S. regulators accuse Palantir of bias against Asians by vidarh on Monday September 26, 2016 @10:11PM (#12587047)
Personal bias potentially factors in the moment your evaluation of the solution goes beyond "works" or "doesn't work" and into subjective evaluation of the code quality.

Personal bias also potentially factors into how you describe it (so consider presenting it written, in the same format for everyone). E.g. let's say the interviewer goes into extra detail or ask for confirmation of understanding from candidates they favour.

Re:U.S. regulators accuse Palantir of bias against Asians by kstenerud on Tuesday September 27, 2016 @04:07AM (#12588075)
Too bad it didn't stop the bias in my Google interview :/

Passed through all the on-site interview problems and then they silently dropped me. No "we're sorry, you're not a good match." No emails, no phone calls. Nothing.

Re:U.S. regulators accuse Palantir of bias against Asians by Chris2048 on Tuesday September 27, 2016 @09:54AM (#12589577)
What bias does this show?
Re:U.S. regulators accuse Palantir of bias against Asians by api on Monday September 26, 2016 @07:39PM (#12586523)
I've seen American university CS grads wash out on FizzBuzz level questions at alarming levels as well so this is not exclusively a phenomenon with these backgrounds.

How in the world are people making it through schools (with a MS!) without actually.... uhh.... you know.... knowing the subject at all?

Re:U.S. regulators accuse Palantir of bias against Asians by vidarh on Monday September 26, 2016 @10:25PM (#12587089)
The question is if the questions asked are really "FizzBuzz level" questions, or algorithm questions that are easy to consider of similar complexity when you know the expected algorithms.

When I studied CS, data structures and algorithms was the second CS course we were expected to take, right after "introduction to programming". It would usually be taken in the second semester.

That's the last time we were tested on a long range of algorithms, except indirectly if we happened to need a given algorithm to complete our work later. In the 22 years since, I've probably needed e.g. a depth first search once, and many of the algorithms I learned I've never touched on since.

So for many, it boils down to whether or not you cared about and liked that course. I happened to love it - I read the set texts the first weekend of the course, and spent a lot of time reading up on algorithms in the years before and after. But for a lot of my class mates it was a course they had to endure to get to more interesting stuff. Many of them would go on to do very well in other subjects.

If they can't figure out a problem like FizzBuzz given a complete description, then that's a deeper problem. But a lot of algorithm questions can sound like they are on that level because we expect people to know a catalogue of algorithms that most developers don't actually need through most of their careers.

Re:U.S. regulators accuse Palantir of bias against Asians by sheeshkebab on Monday September 26, 2016 @11:46PM (#12587312)
^^ - this.

same here - almost 20 years of dev, last time I needed to implement basic cs algorithms were in college and grad school classes (and some idiotic corporate interviews where preferred way of coding is apparently using a white board).

basic knowledge of fizbuzz, dfs, bfs, quicksort, and similar things of course is needed - however asking developers actually implement them in front of you is pointless, at least as far as job performance goes.

Re:U.S. regulators accuse Palantir of bias against Asians by morgante on Tuesday September 27, 2016 @03:42AM (#12588005)
> basic knowledge of fizbuzz, dfs, bfs, quicksort, and similar things of course is needed

FizzBuzz is not some arcane algorithm. You don't need to study it.

It's literally writing a loop, testing equality, and printing some output. I don't know how you could program professionally and not be able to solve FizzBuzz.

Re:U.S. regulators accuse Palantir of bias against Asians by vidarh on Tuesday September 27, 2016 @02:55PM (#12592043)
People should be able to solve FizzBuzz provided it is explained properly and fully.

This is the same for a lot of the basic algorithms we learnt and forgot.

This, to me is the big caveat. Just as there are a lot of people who are horrible at solving stuff they should easily be able to, I've conversely seen so many horrible interviewers that under-specify the problems they ask about because they assume people should understand algorithms that would make it easier to understand, or just assume people will infer things most people wouldn't.

Re:U.S. regulators accuse Palantir of bias against Asians by nazgob on Tuesday September 27, 2016 @03:16AM (#12587937)
Why do you bundle fizbuzz with some legit algorithms that require some knowledge? Fizzbuzz is a gimmick, deliberately picked as something very simple to filter out clowns. I can't imagine a more simple programming task. Any suggestions? ;)
Re:U.S. regulators accuse Palantir of bias against Asians by AtheistOfFail on Tuesday September 27, 2016 @05:05AM (#12588244)
Simple variable swap?

"Take these two variables, derpyOne and derpyTwo, and swap their values"

Re:U.S. regulators accuse Palantir of bias against Asians by chopin on Tuesday September 27, 2016 @05:10AM (#12588258)
Write "Hello World" in your favorite language...
Re:U.S. regulators accuse Palantir of bias against Asians by morgante on Tuesday September 27, 2016 @03:40AM (#12587999)
A lot of people are pushing back on you, but I've seen the exact same thing. I think everyone who hasn't interviewed developers would be surprised by the general incompetence, but everyone who runs an interview process realizes that 80+% of "developers" are terrible.

For the record, I'm absolutely not talking about algorithms questions. I'm talking about literal FizzBuzz. A majority of candidates cannot solve it in 15 minutes.

> How in the world are people making it through schools (with a MS!) without actually.... uhh.... you know.... knowing the subject at all?

It's through a combination of:

1. Tests being based on memorization, not actual knowledge or programming. If you manage to stuff enough keywords into answers, it's possible to pass.

2. Lots of group work. The 20% of students who actually know how to program finish the project while everyone else slacks off and asks for help "with this one thing."

3. Outright cheating. There's a thriving market in recycled homework and exam answers.

Re:U.S. regulators accuse Palantir of bias against Asians by TulliusCicero on Tuesday September 27, 2016 @04:46AM (#12588192)
> everyone who runs an interview process realizes that 80+% of "developers" are terrible.

No, 80% of people in the 'currently looking for a job developer pool' are terrible. But you have to consider that the worse a candidate is, the longer they stay in that pool. So judging developers as a whole based just on interviews makes them look much worse than they are.

Re:U.S. regulators accuse Palantir of bias against Asians by morgante on Tuesday September 27, 2016 @05:04AM (#12588241)
Good point, that's always an important thing to remember. The average job applicant is much lower quality than the average developer.
Re:U.S. regulators accuse Palantir of bias against Asians by Balgair on Tuesday September 27, 2016 @12:07PM (#12590646)
Maybe. With a large enough population for either the job-hunters or the employed, you should regress to the mean for the total population and the deviation should also be similar. This assumes a normal distribution for the metrics that you are hired for, something that may not be in fact true, ie. Poisson or exponential distributions are reasonable. What you can take away from this: Your own developers may not be as good as you think they are OR they may be much better, same for the candidates. That particular day you interviewed them they may have been exceptional or they may have been ill and they failed, or a million other reasons. I think Google came out a while ago and said that their initial hires had no correlation to the really successful people in the company after...5(?)... years. I can't find the citation, sorry. The interviewing process is known to be broken, so trying to extrapolate to say that the job-seekers are less good at these metrics than the employed is erroneous. I'm not saying you are wrong, just that using a binary decision like this to determine these things is wrong.
Re:U.S. regulators accuse Palantir of bias against Asians by morgante on Tuesday September 27, 2016 @12:31PM (#12590842)
> With a large enough population for either the job-hunters or the employed, you should regress to the mean for the total population and the deviation should also be similar.

You're right that the actual population of all job applicants over time is equally qualified to the employed developers.

However, the data that I have available to me as a hiring manager is the sample of developers who actually applied to my job. In that sample, incompetent developers are much more likely to be present because a competent developer only sends out <15 applications before getting a job while the incompetent ones can send out hundreds.

At any given moment, a competent developer is more likely to be employed than an incompetent one. Hence the incompetent ones are constantly generating job applications at a much higher rate than their actual presence in the population would suggest.

For the record, this isn't merely theoretical. The last time I was looking for a job, I was able to get an offer from the second company I applied to. Meanwhile a friend of mine with barely any experience had to apply to about 50 places before getting a single offer. If you were to pull a random sample of our applications, his would be way over-represented.

> think Google came out a while ago and said that their initial hires had no correlation to the really successful people in the company after...5(?)... years.

Sure, but Google still spends a lot of time and money on interviewing because anyone they hire has to be better than the average applicant. They get huge numbers of job applicants, the majority of whom are grossly unqualified.

> The interviewing process is known to be broken, so trying to extrapolate to say that the job-seekers are less good at these metrics than the employed is erroneous.

There are lots of problems with the interview process, but I'm really including anyone who managed to get to an interview (past the phone screen) in the "competent" category. There are seriously huge number of job applicants who can't program a basic loop without extensive help.

Re:U.S. regulators accuse Palantir of bias against Asians by vonmoltke on Tuesday September 27, 2016 @01:05PM (#12591113)
> However, the data that I have available to me as a hiring manager is the sample of developers who actually applied to my job.

Actually, you only have the sample of developers you interviewed for the job. How many didn't get an interview? Are you confident that your resume filter is good and that the resumes rejected were actually bad?

> Meanwhile a friend of mine with barely any experience had to apply to about 50 places before getting a single offer.

Following up my previous point, how many interviews did that yield? The discussion here is over developers who look like idiots in the interview. Confusing that with applications clouds the discussion.

Re:U.S. regulators accuse Palantir of bias against Asians by morgante on Tuesday September 27, 2016 @01:22PM (#12591273)
> Actually, you only have the sample of developers you interviewed for the job. How many didn't get an interview? Are you confident that your resume filter is good and that the resumes rejected were actually bad?

More specifically, I have the sample of developers who I did a phone screen with.

I'm reasonably confident that my resume filter is "good" in the sense that it's not rejecting people prematurely. If your resume shows any hint that you'd be able to do the job (ie. any amount of programming job experience and/or a CS degree) then I'm willing to give you 15 minutes.

> Following up my previous point, how many interviews did that yield?

A dozen or so. I'm deeply skeptical that the pool of applicants would be better than the pool of interviewees.

Re:U.S. regulators accuse Palantir of bias against Asians by TulliusCicero on Tuesday September 27, 2016 @12:10PM (#12590669)
IIRC Google said that their interview scores didn't correlate with how successful people were in the company. But you have to remember that obviously they're only talking about people who made the cut, so people who had at least moderately high scores to begin with.
Re:U.S. regulators accuse Palantir of bias against Asians by dabockster on Monday September 26, 2016 @08:18PM (#12586711)
> How in the world are people making it through schools (with a MS!) without actually.... uhh.... you know.... knowing the subject at all?

Recent undergraduate grad here. A lot of the algorithms I've seen on technical interviews were only covered once or twice in the curriculum. Basically, one such algorithm would come up in either the data structures or algorithms class, we would then work on it for the given assignment/exam, and finally we would move on from it. Subsequent course work would barely reference it.

These things are best learned through repetition. Unfortunately, with all of the other CS coursework topics that I was being educated on, it seemed like there was little room for the repetition to take place. (At least, not in the stereotypical four year timespan assuming that the given student enters a CS program with no prior programming knowledge.)

Re:U.S. regulators accuse Palantir of bias against Asians by NoPiece on Tuesday September 27, 2016 @12:38AM (#12587460)
If you know even some basic programming and logic, you should be able to come up with a reasonable fizz buzz solution. You don't need to have studies the fizz buzz algorithm in college, or have practiced a solution.
Re:U.S. regulators accuse Palantir of bias against Asians by jnordwick on Tuesday September 27, 2016 @01:58AM (#12587736)
I spent weeks on that algorithm. It is only through daily katas that I still remember its rigors.
Re:U.S. regulators accuse Palantir of bias against Asians by tominous on Tuesday September 27, 2016 @01:48AM (#12587697)
> ..assuming that the given student enters a CS program with no prior programming knowledge

This is bizarre to me. It's like someone signing up for a music degree having never played an instrument. Maybe you'll cram enough to pass a test on the theory, but it's useless knowledge. It's unanchored and will float away.

Re:U.S. regulators accuse Palantir of bias against Asians by sgift on Tuesday September 27, 2016 @02:44AM (#12587861)
Or a medical student who never did an operation before? Arts are the exception, not the rule. In other areas it is fully understood that the whole purpose of the program is to teach you everything, so actually saying "you have to know this before" would be weird.
Re:U.S. regulators accuse Palantir of bias against Asians by tominous on Tuesday September 27, 2016 @03:06AM (#12587912)
Medical students are expected to have a strong science background, and well before they commit to being a surgeon they'll have units where they need to wield a scalpel. If they find out it's not for them there are plenty of other paths which don't involve surgery.

Engineering students are expected to have a strong maths background. If you can't do algebra and basic calculus then there's no chance of getting in.

It's completely reasonable to expect a CS student to have experience programming.

Re:U.S. regulators accuse Palantir of bias against Asians by sgift on Tuesday September 27, 2016 @04:06AM (#12588071)
> It's completely reasonable to expect a CS student to have experience programming.

If you say so. I neither see the reason nor the advantage. Don't get me wrong: I had experience in programming before entering a CS program, but I had fellow students who never did any programming before and they did just fine, while others with programming experience failed. And I'm pretty confident that all of them who managed to stay through the introductory year were/are able to do FizzBuzz.

Re:U.S. regulators accuse Palantir of bias against Asians by chii on Monday September 26, 2016 @09:17PM (#12586929)
I would expect that the project they work on to utilize the knowledge in the courses. With 4 projects a year at 4 years, there's got to be something learned!
Re:U.S. regulators accuse Palantir of bias against Asians by pavel_lishin on Monday September 26, 2016 @09:32PM (#12586951)
I got a BS in CS, graduated in 2006. What 4 projects? We had one project that lasted an entire semester, in one class; the rest was mostly one-off homework assignments that were very much topic-of-the-week. And most of them didn't really require coding.
Re:U.S. regulators accuse Palantir of bias against Asians by chii on Tuesday September 27, 2016 @05:59AM (#12588386)
If this is really as common as you imply, then no wonder many grads are lacking in exp. I thought 4 projects was on the low end...
Re:U.S. regulators accuse Palantir of bias against Asians by sib on Monday September 26, 2016 @07:56PM (#12586617)
"How in the world are people making it through schools (with a MS!) without actually.... uhh.... you know.... knowing the subject at all?"

I'm sure that there are many more people who could complete FizzBuzz on a homework assignment, with the help of the Googles, than could do so in an interview. And there are many mid-tier MS programs that are happy to take money from international candidates and give them every opportunity to keep paying.

Re:U.S. regulators accuse Palantir of bias against Asians by douche on Monday September 26, 2016 @08:31PM (#12586769)
Computer science programs, even at very prestigious schools, don't really require you to know anything about programming or practicality using computers. The amount of real hands-on work I did for classes in my entire undergrad career is less than I do in a good week at work.
Re:U.S. regulators accuse Palantir of bias against Asians by throwaway8976 on Monday September 26, 2016 @07:57PM (#12586623)
> I've seen American university CS grads wash out on FizzBuzz level questions at alarming levels as well so this is not exclusively a phenomenon with these backgrounds.

Absolutely. They may even have washed out at higher numbers. The applicant pool described in the complaint definitely isn't representative of US CS majors nationwide, so you can't use it to draw inferences about the quality of students overall.

Re:U.S. regulators accuse Palantir of bias against Asians by 67726e on Monday September 26, 2016 @08:01PM (#12586639)
I'm rather shocked by this as well. I understand not knowing the latest frameworks and such, but I have close personal friends that say my name should be in parenthesis next to theirs on their diplomas. A lot of CS courses can be passed by getting help on take home assignments and rote memorization on tests. At least for your typical state schools.
Re:U.S. regulators accuse Palantir of bias against Asians by porpoisemonkey on Monday September 26, 2016 @07:41PM (#12586531)
Does Palantir make US citizenship a requirement for most of its job positions? My understanding is that this is common place for most US military contractors but I was wondering if this applies to government contractors at large.
Re:U.S. regulators accuse Palantir of bias against Asians by throwaway8976 on Monday September 26, 2016 @07:49PM (#12586584)
Not for the positions I was interviewing for.
Re:U.S. regulators accuse Palantir of bias against Asians by ardacinar on Tuesday September 27, 2016 @07:04AM (#12588634)
US citizenship is a requirement if you are going to do something related to the US government. I've worked for them in a position not related to the US government(not a US citizen myself) and the number of technical people who also happened to be US citizens were quite low.
Re:U.S. regulators accuse Palantir of bias against Asians by Zigurd on Monday September 26, 2016 @10:00PM (#12587021)
Both sides of this issue are wrong. On the one hand, If I knew, based on online articles about the interview process, that there is a set of 100 questions out of which I might get asked 20, I'd prep on those 100 questions. It seems like the interviewees are underpreped for interviewing. That's sloppy. Maybe that's a reason not to hire them, but it probably isn't the best way to select hires.

On the other hand this process makes about as much sense as requiring that I know how to shift a non-synchronized manual transmission in order to pass a driving test. Nobody is implementing most of these algorithms from scratch, and if they did it would be a bad practice without having a good reason to do it.

Re:U.S. regulators accuse Palantir of bias against Asians by daveFNbuck on Monday September 26, 2016 @11:24PM (#12587240)
You'd have a good point in your second paragraph if we were talking about implementing a Fibonacci Heap or an AVL tree. But the comment you're responding to is about people failing FizzBuzz.
Re:U.S. regulators accuse Palantir of bias against Asians by Zigurd on Wednesday September 28, 2016 @04:14PM (#12600941)
Good point, FizzBuzz should take a couple minutes. AND it's the sort of thing a prepared interviewee should nail. I'd hope the rest of the interview would focus more on real-world considerations.
Re:U.S. regulators accuse Palantir of bias against Asians by ryuker16 on Tuesday September 27, 2016 @12:52AM (#12587505)
Im guessing they assumed the CS degree was a magic job getter and were too cocky to study
Re:U.S. regulators accuse Palantir of bias against Asians by StreamBright on Wednesday September 28, 2016 @09:40AM (#12597506)
We introduced homework to filter out candidates who could not complete FizzBuzz level tasks. 70% of applications can be filtered by simple home work.