I'd like to believe this is true, but it fails to explain why candidates for other business functions don't receive the same scrutiny.
I'm not aware of analogous evaluations to get hired to other business roles (e.g. marketer candidates aren't asked to demonstrate a working knowledge of the Google ads dashboard, accountants aren't expected to clean up a fake P&L on their own time for review by hiring managers, etc).
I could be wrong and always welcome correction, but from anecdotal experience talking to friends and work colleagues, the bar for SWE hiring is much, much higher, even controlling for compensation.
Of course my cousin who is a lawyer at Cravath works like 3x more hours harder than I do. She gets paid like 2.5x more too. They just hire tons of people and let the job weed out the bad ones. Most engineering teams can't do that because we're not trying to squeeze 100 hours a week of work out of our engineers.
Of course, plenty of teams do basic work. But plenty of teams with even basic sounding work have to handle an absolutely huge amount of complexity.
This would help everyone from SWE itself (by tracking problem solving process) to his manager, colleagues and everyone who will work after and it's a ready draft for a blog article that'll say more about them than any CV.
I work at a place where design documents are supposed to include the alternatives that were considered and rejected, for much the same reason, and this does work to an extent, but it's not quite what you're suggesting.
Designers need to present designs / their portfolio.
Sales people need to do a demo.
Product people need to put together a mock roadmap or pitch a feature.
And so on.
As someone married to a designer, this is soooo much easier than the hoops programmers have to go through.
Might take a little more work upfront (or just printing out work from previous jobs if allowed), but then you just flip through an existing portfolio the night before, and bring the same portfolio to every interview, no extra prep required.
Meanwhile, a programmer has to perform intense 1-8 hour tests every single time they apply anywhere, and make sure they remember the answers to gotcha questions in about 30 different subjects they could be asked about.
My wife always goes to way more interviews and talks to way more recruiters than I ever have (probably 5x more), because all she needs to do is read through her portfolio and practice some questions for 30 minutes the night before. And her interviews are usually just one or two hours long.
Meanwhile I always have to spend weeks brushing up on Leetcode before making a big new job push to make sure I don't have too many surprises, and I avoid going on interviews because it'll be long grind that I usually have to take half a day off work for.
I still had to do the stupid technical tests for a mobile app job where I could tell them to go to the app store and download a game of mine, with my name on the title screen, and they could play it, and they were really impressed with the game (the Xbox 360 version of it won a game design award in a contest hosted by Microsoft, and it looked and played identically).
Like... come on.
1. Do an in-interview programming test. We try to make this as "real world" as possible with limited time, i.e. we give the candidate some existing code (which is similar but "slimmed down" compared to our actual code) and tell them to enhance it by adding some feature, then in some cases we had another piece of code with some bugs and asked them to fix them and write test cases.
2. Do a take home programming problem. I like to give people the option because some folks just do really poorly under the pressure of an in-interview test. When it's finished and they come back, we review it together and talk about their choices, etc.
3. If the programmer has lots of publicly reviewable code, I ask them to just share it with me so then I can review it and discuss it when they come in.
I basically just need to understand "Can this person write code?", and, related, "Can this person take a request in English and translate it to code quickly and efficiently?" And despite giving these choices, when I've posted a description of this on HN in the past I was still flooded by responses about how I shouldn't expect any of this: "I have a real life, I don't have time to do your take-home problems", or "I've been working in industry for years and coding for a job, all that code is proprietary and I can't show it."
All that may be well and good, but then my interview process is working - I don't want to hire you, and I can find people I do want to hire that are willing to do one of those 3 things, and it's not my job to make you understand that. Honestly, for all of the bitching about technical interviews, I feel a huge part of it is that:
1. People just can't accept that there are other people that are better than them that do do well on technical interviews and excel on the job.
2. Yes, there are outliers, and you might be one of them, but it's hard to craft an interview process around outliers. I also agree with Joel Spolsky's mindset of "It's better to pass on someone who might be OK, but you're not sure, than take the risk of a bad hire." I feel like every time I've made a bad hire there were definitely yellow flags during the interview that I tried to explain away, but I always ended up regretting the hire later and I've become more hardline on "if you can't prove your skills in the interview, I'm going to pass".
From my admittedly limited understanding, many of those openings are filled based on resume and verbal interviews with little or no quantitative evaluation of skills.
Software engineering doesn't necessarily have a higher bar than other comparable STEM.
And lest we forget many other roles have to pay their dues upfront at a much earlier stage: doctors have the MCAT, lawyers have to pass the bar, many accountants become CPAs, etc.
You're right about exams, but that's a one time thing. New lawyers, doctors, and CPAs have to demonstrate textbook mastery to pass a handful of exams once in their career. Engineers are expected to demonstrate textbook mastery for every job they apply to _for their entire career_ (and often multiple times per application!)
It's also worth noting that engineers have standardized exams and certifications, like CompTIA or AWS Certs, but for whatever reason those credentials do not seem to carry much weight. I've never heard of those replacing technical evaluations, just used to enhance a resume.
I know this to be true for many working in software engineering. Conversely,
> writing code is way more than reading and implementing syntax, it's actually making the design work or solving very tricky bugs.
This can be true but is not always true. I think you were right when you said
> take any given <sales|tech|branding|marketing|HR> idea you want, it doesn't "just work", the devil is in the details
:)
New lawyers, doctors, and CPAs have to demonstrate textbook mastery to pass a handful of exams once in their career. Engineers are expected to demonstrate textbook mastery for every job they apply to _for their entire career_ (and often multiple times per application!)
everyone you mentioned here has some kind of an ongoing public tally going on - Yelp/Google reviews, customer referrals that lead to new business or lack thereof. If I'm looking at a crappy lawyer or accountant, they probably have a 2* average of public reviews and/or out of business because noone wants to refer to them. Is there an equivalent of that for a mid-career programmer?
> EMTs need to get an EMS license/certification
I love EMTs. I was one. I'm a paramedic. I train new EMTs. But the EMT course is 160 hours, and is designed and tested to be passable as a high school junior. Let's not use that as a comparison.
Most of these positions also have zero to minimal continuing education requirements which often, let's be real, are trivial. Quick online courses that can be busted out in a couple of hours, or "go to this hotel in a nice location, spend a couple of days, and go to the conference room off the lobby for a couple of hours in the morning".
Software engineering? You have people saying here - with a straight face - "Yeah, a 3-4 hour take home exam at every company you interview at is entirely reasonable" for the rest of your professional life.
There's really some truth to the licensing thing. In some ways, I'd really like our field to adopt certifications so we can skip the BS of interviews. I got the leetcode certification, let's talk design or something relevant please.
I don’t know where this idea comes from. Other roles at most companies I’ve worked for have had plenty rigorous screenings for people, often including more reference checks, portfolio reviews, work samples, presentations, and other things.
Programmers are terrible at estimating and programmers will choose tasks that are obvious to them because it's the exact thing they do every day, but it might not be so easy for people not in their exact niche.
I disagree. Maybe and only if it's paid and paid well. Maybe $150 an hour. Not many who are good will put up with that; because they don't have to.
Let me propose a variant of that: "you'll end up with monkeys if you require people to do monkey tricks".
I think these folks are moreso annoyed by academic quizzes cribbed from 70's programming books that don't flex anything we're interested in, and do focus on things that are typically not very relevant to the job. Oddly they do seem to both prioritize new grads that are willing to shovel shit, and at the same time reject experienced folks that don't have the time for said shit.
What most people object to is stuff that's just really time-consuming to do well. And/or stuff that gets rejected for silly reasons (typically requirements that weren't actually stated).
Or things like "please implement Conway's game of life in 30 minutes. START NOW".
You can't believe the amount of shit solutions we've gotten from candidates. We just let you make a very simple kata. A tiny program that generates some console output, you have to refactor it to make it prettier and you need to add one feature. Literally half of the people fail to make it work. Many others just show zero effort for code cleanliness. That's all we ask, make it work and make it look pretty.