FAANGS may have the funds together to hire out probably the rest of the entire software developer market but it doesn’t do them as much good to have laggards that can’t pass a FizzBuzz test. Sure works for a lot of defense contractors’ business models though, especially if the candidates are cleared.
If you just need someone for narrowly-scoped tasks like fixing specific bugs, it might be better to hire a contractor, so the role expectations can be well-defined and agreed to up front.
It’s pretty evil IMO to hire people as FTEs into such organizations when you are probably better off with consultants that are at least used to short term gigs.
Then there's the "unintentional" body farms that organize due to structural reasons of massive funding combined with labor structure dictated to support a massive enterprise. Within defense, almost all the major defense contractors like Northrop, Lockheed, General Dynamics, and maybe Palantir these days (the bar for hiring is higher overall there, but not quite the full story) fight for huge, bloated Pentagon budgets that resembles VC funding except with military officers as partners and minimum headcounts are usually specified in contract vehicles. You'll oftentimes see at least n PhDs on staff, m veterans, p program managers, etc. as competitive factors for getting a contract ahead of other companies because with too small of a company it's deemed a risk to the government (people do take vacation, get into accidents, etc.). While there's been some efforts to make the RFP process better aligned towards outcomes, everything I've heard since I left the community has not been encouraging.
I'd actually say the opposite: standout engineers can be very valuable, I'd rather work on a team with a couple lemons and one really good engineer than 3 middle of the road engineers. So I think that false negatives can be damaging, especially because it's probably the best people with the most options who won't bother with an excessive interview gauntlet.
I had one hire who was brought in as a junior dev, thought he was better than he was and that he didn't deserve to do the grunt work he'd been assigned, and then proceeded to constantly bitch about anything he could. He was so negative that when he finally moved on I was super relieved.
That psychology of "why even bother" can just sink into people's subconcious and become problematic. It's hard to spot who's going to be like that at an interview though.
Will your standout engineers enjoy working with the lemons?
Generally a hiring process is a good hint to the dysfunctions of a team before you join. Panic about bad hires and a quintuple-filtered pipeline is a good sign of weak management and a structural inability to fire.
But what about a very good hire that you end up missing that has been a very expensive mistake?
I think we have a pretty high bias here. Organizations can see the effect of a bad hire and have more data on what went wrong during the hiring process, retrospect why that person passed and put more "tests" to prevent to repeat the mistake. But organizations can never measure the differential between the impact on the company of a candidate that was not hired and the present condition. There is simply no data about the impact that that person could have had.
I heard a few detailed stories on "the guy that should not have been hired" and I can add my own stories. But the stories on the cool people that should have been hired are brief and rarely go beyond "I thought that guy was very smart."
So I think we should make sure we check our hiring processes against negative positives. How? To be continued...
For most companies missing out on an excellent hire is worse than hiring someone subpar.
It's an expensive (painful) signal that you actually do know what you need to do and are capable of it.
The top tech companies can reject 10 good candidates for every 1 that they hire because there is a massive surplus of engineers who want to work for these companies and so time to hire for them is actually reasonable.
99% of tech companies don’t have the overwhelming surplus of good applicants to make this work. So when they try they see time to hire jump from 4-8 weeks all the way up to 6-12 months without any real decrease in false positives.
A false positive often has negative contribution to the overall training (at the very least taking time from current members without giving back, but often also creating new problems).
A false negative has zero cost (and zero benefit).
I think it's a no-brainer that false negatives are much preferred to false positives in the overall tradeoff (and ... there is always a tradeoff between false positive and false negative)
> A false negative has zero cost (and zero benefit).
False negatives means that your hiring process is longer, more difficult, more costly, and you therefore find it harder to grow, or to replace people who leave.
It may well be that avoiding false positives in general is better for the business, but it's not as clear cut as you make out I believe, it's a balance.
Exactly! If a couple of people on my team of six leave and they can’t be replaced for 6-12 months then I’m going to quit as well.
There will be more pressure on the remaining team to produce and most of the interesting long term work will be put on hold.