News for hackers. Stuff that matters.
Re:The software industry's greatest sin: hiring by sumanthvepa on Thursday April 09, 2020 @09:55PM (#22829186)
This makes so much sense. I've stopped doing in-depth technical interviews for precisely this reason. Instead, I take the developer out for lunch and spend an afternoon discussing our software stack and business with them. It always gives be better results. There is no stress. I don't want to see their code, but I do want to understand how they think and work.
Re:The software industry's greatest sin: hiring by mattbillenstein on Thursday April 09, 2020 @10:23PM (#22829370)
You should absolutely see how they code - I've interviewed so many people on the phone who couldn't code their way out of a paper bag, but they could speak to it enough to fool you.
Re:The software industry's greatest sin: hiring by dvt on Thursday April 09, 2020 @10:42PM (#22829467)
> ...but they could speak to it enough to fool you

I keep hearing about this mythical coding con man, but I've yet to find anyone that can both have an intellectually stimulating conversation about a technical topic while at the same time suck at coding. I can generally tease it out in 15 minutes tops.

Re:The software industry's greatest sin: hiring by lsalvatore on Friday April 10, 2020 @12:28AM (#22829973)
One time I hired someone who provided a very intellectually stimulating conversation over the phone.

He couldn't ship anything.

Now, I make sure I ask someone a question over the phone, and watch them code. You could call it an IQ test. I call it a technical interview.

Re:The software industry's greatest sin: hiring by recursive on Thursday April 09, 2020 @10:48PM (#22829504)
You may be better at interviewing than some of us. Personally, I can't figure out how to tell if someone can actually write code in a conversation.
Re:The software industry's greatest sin: hiring by AlwaysBCoding on Thursday April 09, 2020 @11:09PM (#22829629)
ask them what they've built in the past and start digging in from there.
Re:The software industry's greatest sin: hiring by recursive on Thursday April 09, 2020 @11:46PM (#22829816)
I've certainly done that. But if it's in a domain I'm not familiar with, I'm not going to be able to tell if its real.
Re:The software industry's greatest sin: hiring by grecy on Friday April 10, 2020 @12:14AM (#22829918)
Don't focus on the domain, focus on the coding. i.e. don't talk about what they were doing, talk about how they did it. Where there any performance considerations? concurrency? what did they do for testing? was it automated? How the thing deployed? do they maintain it? etc. etc.

In doesn't matter that in all of the above I'm talking about the code used to talk to little green men on Mars (which you know nothing about), but it matters how I used code to solve all the problems which are common across all kinds of software.

Re:The software industry's greatest sin: hiring by lsalvatore on Friday April 10, 2020 @12:49AM (#22830068)
How much faith do you really have in these questions?

This could be your entire 45 minute interview:

Where there any performance considerations: Yes, the spaceship was extremely slow at first. After reverse engineering the launch protocol, we discovered that we could increase speeds by 5x simply by limiting the fuel cell usage. "Oh tell me about your rocket fuel cell usage"- Well, we have this thing called a fuel cell. It takes 5 batteries. 10 minutes of business logic later...

* Now let's spend 25 minutes talking about infrastructure and team dynamic * Concurrency: None needed here. What did they do for testing: We used Jest. Was it automated: Yes. How was it deployed: Github / Heroku / AWS Do you maintain it: Yes, we maintain it with my little green friends. We each take turns writing code and maintaining the rocket protocols. It's actually quite nice.

* Oh, well I guess we're out of time. *

Congrats, you just hired a guy who read a few blogs and made up a few stories.

Re:The software industry's greatest sin: hiring by grecy on Friday April 10, 2020 @11:51AM (#22834267)
> How much faith do you really have in these questions?

It depends entirely on how you direct the converstation.

> After reverse engineering the launch protocol, we discovered that we could increase speeds by 5x simply by limiting the fuel cell usage

Tell me HOW you reverse engineered it. What tools did you use. What source did it wind up as. What problems did you encounter?

>Oh tell me about your rocket fuel cell usage

(Don't ask that question because you don't care about rocket fuel cell usage, you care about if this person is a good coder. Ask them questions about code and their person software process!)

>What did they do for testing: We used Jest. Was it automated: Yes.

Obviously it's on you to tease out more than one word answers.

If you want to have a conversation with somebody and learn if they're capable of something, the onus is on you to direct the conversation and get what you need. If you're willing to accept one word answers, then I'm thinking this "informal chat over a few hours" approach is not for you.

Re:The software industry's greatest sin: hiring by lsalvatore on Friday April 10, 2020 @03:35PM (#22836556)
Agree with all your points, I'm just coming from the perspective of how I embarrassingly hired a guy who could answer a lot of these questions but couldn't solve the problems we needed him to solve.

And that, by switching to the "Hello, nice to meet you, okay let's open up Coderpad and solve this problem", as "inhumane" as it sounds, and I KNOW we will continue to see these forum threads for years to come, it actually WORKED to find some seriously amazing candidates who could actually showcase their skills LIVE.

It's like, there's knowing your implementation details, and there's actually implementing something.

Honestly, as a candidate, I prefer the technical challenge now. Partly because my brain isn't equipped to even remember deep implementation details of specific projects. Think about it, how much can you really remember from the last project you worked on? Is that result going to give you more concrete details than actual code on a small problem? I think companies will continue to use Coderpad because it just gets to a clear result faster.

Re:The software industry's greatest sin: hiring by grecy on Friday April 10, 2020 @04:39PM (#22837109)
Obviously the way this goes down is different for each interviewee and each interviewer.

I personally remember a lot of details from some of my favourite projects, but I wouldn't hesitate to say "let me grab my laptop and I'll show you" because it will be clearer. Then I'd walk the interviewer though all the details of the code, deployment, testing, etc. etc. etc.

Re:The software industry's greatest sin: hiring by lsalvatore on Friday April 10, 2020 @11:07PM (#22839381)
Yeah valid points, some companies do that, but I don't think that scales to every candidate who doesn't have a project that isn't protected IP.
Re:The software industry's greatest sin: hiring by bostik on Friday April 10, 2020 @03:36AM (#22830840)
> your entire 45 minute interview

There's your problem. Right there.

I don't think we can evaluate whether someone can do a decent job in 45 minutes. Or an hour. Sure, we can spot and confirm a hopeless case in 20. But beyond that, an hour is simply not enough.

I've been involved in hiring and interviewing for close to 15 years. The best results have been with candidates with whom I've arranged to have at least 90 minutes, and where that time ended up being well spent. It takes a while to get comfortable, to warm up, to establish a common ground. And it sure as hell takes time to actually discuss a technical problem, whether it's design or a programming problem, as the solution unfolds.

The desire to shoehorn an interview into at most 1-hour slots is not designed to find the best candidates. From where I look at things, it's designed around the idea that most business meetings are booked for one hour each, and the cadence in the day must fit the business of, well, doing business. And it kind of works, because everyone (or near it) has the context and shape of the problem fairly clear in their heads.

But for an interview? A process, where by definition you are dealing with people who are not well versed in your business? Companies book 1-hour interview slots because it's convenient - for their employees, including those who have no part in the interview process, but who are expected to attend other 1-hour meetings with the people who are involved.

The gauntlet of 1-hour interviews feels like a very much intended consequence of the organisation thinking in terms of 1-hour slots for everything. The result is a grueling exercise very few like, and almost everyone with experience despises. It's bad for the candidates, it's bad for interviewers, and I'm pretty sure it's bad for the companies.

But it keeps getting done that way because the cargo-cult of 1-hour slots for everything can not be reasoned with, or deviated from, results be damned.

Just think how well you would do the engineering and programming part of your profession if you had to carve everything into 1-hour slots. After all, PG wrote about it back in 2009: http://www.paulgraham.com/makersschedule.html

Re:The software industry's greatest sin: hiring by webo on Friday April 10, 2020 @12:48AM (#22830057)
I’ve done over a hundred technical interviews in the past 5 years. You can tell a lot about someone by quickly glancing over a project source code, comments, documentation, automation, etc vs talking to them for an hour or two. (to be clear I’m not talking about live coding or take-home problems)

There are bunch of people who can sound smart by just referencing stuff they read online or in the books.

I don’t focus on specific technologies or frameworks because everyone has different backgrounds. However I do focus on CS fundamentals and software engineering practices. These don’t say much about actual coding skills.

Re:The software industry's greatest sin: hiring by google234123 on Friday April 10, 2020 @12:49AM (#22830067)
For all you know they might have just followed some online tutorial.
Re:The software industry's greatest sin: hiring by read_if_gay_ on Friday April 10, 2020 @01:39AM (#22830302)
You can figure out whether they actually understand what they’ve done by asking the right questions. E.g. not “how did you do that” but “why did you do it this way and not that way?”
Re:The software industry's greatest sin: hiring by hoorayimhelping on Friday April 10, 2020 @09:51AM (#22832975)
You ever worked with someone who was really good at setting up environments? Or really good at refactoring the structure of the code? They'd always be pushing fixes and updates, and writing tutorials on the perfect environment set up, but when you look at their work, you realize they never actually shipped any products that required taking a risk or trying something unknown. All they did was restructure code that other people wrote.

These people are really good at having intellectually stimulating conversations. They're the kind of people who lurk on hobby forums and can tell you all about the hobby, but have never actually done it themselves. They're the people for whom the phrase, 'do you even lift' was coined. They'd lurk on /fit/ and talk about form and theory, but would never post any videos of themselves. They can tell you why you want to drive your hips out of the bottom of a squat, but they've never actually felt what it's like to be at the bottom of a squat and want to just give up and have to grind through it. They're the people who watch twitch streamers and think they're good at the game cause they understand the decisions the streamer was making, but they've never actually had to make those decisions themselves under pressure.

I've worked with a handful of these people over the years. They usually get in early and embed themselves in way that makes them seem important or very knowledgeable.

Re:The software industry's greatest sin: hiring by missosoup on Thursday April 09, 2020 @10:40PM (#22829461)
Maybe enough to fool you.

It's pretty easy to tell if someone knows a topic or not by just asking increasingly more specific technical questions to follow up on their answers.

Re:The software industry's greatest sin: hiring by mattbillenstein on Thursday April 09, 2020 @11:29PM (#22829747)
Maybe - I mean, you just get signal from actual coding, I think it's pretty hard to discount entirely. How they solve problems, what mistakes they make, how they debug - I think it's just too valuable to not spend some time on.

And I'm not giving them riddles - I give them easily solvable problems that can be done in almost any programming language. And I've given the same problems enough to know what it canonically looks like in a dozen languages.

Re:The software industry's greatest sin: hiring by sumanthvepa on Thursday April 09, 2020 @11:13PM (#22829648)
This exactly. Start with general questions and get more specific until they are unable to answer or they exceed the depth of your own knowledge on the topic. You’ll be surprised how often that good candidate will take you out of your depth.
Re:The software industry's greatest sin: hiring by sumanthvepa on Thursday April 09, 2020 @11:07PM (#22829615)
Turns out that I don’t actually need to. For us, as developer you will almost certainly run into tech that you know very little about but need to work with it anyway. So ability learn quickly and solve problems is more important. So intellectual horsepower, analytical and problem solving skills and most importantly a sense of agency and willingness to do what it takes to ship code out is more important. If the developer’s code isn’t beautiful and idiomatic, I will go and refactor it to make it so after we’ve shipped product. And given that the developer is a quick learner and has experience with writing good code it the past they will pick it up quickly. So I essentially screen on credentials: where did they go to school, where have they worked. and then make decision on the interview.
Re:The software industry's greatest sin: hiring by mattbillenstein on Thursday April 09, 2020 @11:16PM (#22829659)
I think credentials are sorta worthless - I've worked with people who worked at great companies, went to great schools, still very weak at coding and problem solving. I guess ymmv.

Also, you personally refactoring people's code after the fact is not a great way to go about team building - I would try to get more of this into the PR process, teach them what they're not doing rather than do it for them.

Re:The software industry's greatest sin: hiring by recursive on Thursday April 09, 2020 @10:49PM (#22829506)
> There is no stress

There's always stress for an interviewee, assuming they care about whether they get an offer.

Re:The software industry's greatest sin: hiring by sumanthvepa on Thursday April 09, 2020 @11:18PM (#22829674)
True. I should have phrased that as less stress. My thought is to keeep the environment as friendly and stress free as possible to let the candidate forget for a moment that they are interviewing. It’s a technique I was taught at Cornell while I was doing alumni interviews for MBA candidates.
Re:The software industry's greatest sin: hiring by agumonkey on Thursday April 09, 2020 @10:29PM (#22829402)
ah man, I proposed a 5min flash version of that. Take me to your war room, I'll show you if I can contribute or not in 30 seconds. I won't resent you, and you won't waste time :)

I'm quite happy knowing people tried this.

Re:The software industry's greatest sin: hiring by hirundo on Thursday April 09, 2020 @10:41PM (#22829463)
Would you hire a sculpter by taking them to lunch and talking about tools but never seeing their sculpture?
Re:The software industry's greatest sin: hiring by KungFuJohnny on Thursday April 09, 2020 @10:54PM (#22829533)
Would you hire a doctor by insisting they perform surgery in front of you? Would you hire a lawyer by demanding they filling out legal paperwork in front of you?
Re:The software industry's greatest sin: hiring by mattkrause on Friday April 10, 2020 @12:04AM (#22829881)
My background is a mix of neuroscience/biology and machine learning, and it's always funny to me how jobs right on that margin interview totally differently, depending on how the organization started.

If they think of themselves as "tech", you're at the whiteboard, reversing strings in C and playing games with trees. When I interviewed for nearly identical job in a "science" department, someone spent 45 minutes chatting with me about the coding behind projects I had mentioned. I even offered to show or write soome code and got told "Nah, we already looked at your github and it's fine."

Re:The software industry's greatest sin: hiring by triceratops on Friday April 10, 2020 @03:55AM (#22830940)
I imagine doctors are rarely hired "cold" - they have some sort of prior relationship with the hiring institution or someone working there. E.g. they are already consulting there, or another doctor who works there has worked with them closely on a case etc.

Same for lawyers. You'd be targeting someone whom you've dealt or worked with in prior lawsuits (maybe they were the opposition counsel), deals (counsel for the other party), or complex cases involving multiple law firms working for the same side.

Re:The software industry's greatest sin: hiring by Apocryphon on Thursday April 09, 2020 @11:54PM (#22829847)
Would you judge a jazz musician by asking him where Miles Davis learned to play music?
Re:The software industry's greatest sin: hiring by jdbernard on Friday April 10, 2020 @12:46AM (#22830046)
No but I absolutely would have them audition.
Re:The software industry's greatest sin: hiring by stevenwoo on Thursday April 09, 2020 @11:06PM (#22829609)
The sculptor’s resume is their portfolio, and having worked on screening artists for jobs, that is the first thing we examined, and for online hires, the only thing we could examine. This is a false equivalence.
Re:The software industry's greatest sin: hiring by StandardFuture on Thursday April 09, 2020 @11:20PM (#22829688)
It is only a false equivalence in that programming literally != sculpting. It is a relevant analogy, however.
Re:The software industry's greatest sin: hiring by stevenwoo on Friday April 10, 2020 @02:30PM (#22835965)
It's still not - we would not ask someone to make a painting or drawing or animation or maquette or 3d model on the spot during an on site/video interview ( maybe you might personally but that generally not practiced) - that is directly analogous.
Re:The software industry's greatest sin: hiring by AlwaysBCoding on Thursday April 09, 2020 @11:12PM (#22829639)
would you hire a sculptor by asking them a random trivia question about the birthday of an Italian architect? FANG would.
Re:The software industry's greatest sin: hiring by google234123 on Friday April 10, 2020 @01:21AM (#22830216)
I don't get what is wrong with expecting a candidate to have carefully read an algorithms book at some point in their lives. Most software engineering jobs expect a degree in CS, that implies 3-4 years of study. You should be able to remember important information related to CS.
Re:The software industry's greatest sin: hiring by dsaavy on Thursday April 09, 2020 @10:05PM (#22829246)
Love this idea, going to steal it for the next time I'm hiring someone.
Re:The software industry's greatest sin: hiring by gwbas1c on Thursday April 09, 2020 @11:14PM (#22829652)
> spend an afternoon

I've never had a full afternoon with a candidate. Maybe if I did I could avoid technical challenges.