News for hackers. Stuff that matters.
Re:Tech Interview Handbook by DavidWoof on Saturday August 17, 2019 @10:47PM (#20727914)
I realize everybody's going to jump in and rant about algorithms in interviews, but I wish you'd all add something constructive as well.

I just had to conduct a round of interviews in a non-SF large US city, and it was a hellish crapshoot. Resumes are meaningless, and often re-written by recruiters to match the job anyway. Everyone has the same canned answers to the stupid behavioral questions. And as for the code, we included what we thought was a trivial nested for-loop problem and virtually nobody could even get started on it.

Is this kind of code problem too complicated in your opinion? For all I join in when complaining about irrelevant algorithmic questions, I have to admit that they at least test something, even if it's just willingness to study for the interview.

Instead of reading everybody's complaints about interviewing, I'd love to hear how you think it should be done. Because I have to admit I'm pretty much lost right now.

Re:Tech Interview Handbook by jjav on Sunday August 18, 2019 @01:18AM (#20728391)
I can tell you how I do it and would certainly recommend it as the way it should be done. For some context, I've been interviewing software engineers for about 25 years in companies ranging from established multi-nationals to tiny startups in very fast headcount-growth mode. I'm in silicon valley. I can say that I've never regretted a hire I said yes to, so the method works to my satisfaction.

It'd be nice to think I have some special skill here but I really don't. This is just how interviewing was done in the 90s. To some of the younger generations, I've been told it sounds crazy.

If you send me your resume I'll actually read it, carefully. If the person described in this resume fits the background experience the role needs, you get an interview.

During the interview we'll talk about all those projects you worked on that are relevant to this role. Which parts you enjoyed the best and why? Which parts were boring and why? Which parts were the most challenging and why? What you find too easy and why? What would you have done differently? Could you have? If you were to do the same project all over how would you approach it? Other open ended conversations along these lines.

I don't ask anyone to whiteboard code, that's not part of the job so it's not part of the interview. No puzzles, no trivia-pursuit style questions.

It works great. You can't BS your way through such a conversation with a senior technical peer if you didn't actually do the work described in the resume. You just can't.

It is, however, vital that the interviewer must be a expert in the field.

Re:Tech Interview Handbook by libria on Sunday August 18, 2019 @07:36AM (#20729611)
> nested for-loop problem

> > No puzzles, no trivia-pursuit style questions.

I swear HN technical interview threads are the poster child of talking past one another. First, for-loop is nowhere near a trivia-pursuit question. Second, different companies of different sizes/industries/goals have different requirements. Let's all move forward with this discussion and acknowledge that we can't all use the same process because we're not all hiring for the same type of job. If the engineers you hire consider for-loops a "puzzle" that's totally fine and OP using it doesn't invalidate your process for your multi-national or startup companies.

> I can say that I've never regretted a hire I said yes to

The real question is, has anyone else regretted that hire, which unfortunately can't be answered as they may not tell you.

> To some of the younger generations, I've been told it sounds crazy.

Doesn't sounds crazy at all. A single process guaranteed to work for everyone? Now that sounds crazy.

Re:Tech Interview Handbook by ryandrake on Sunday August 18, 2019 @12:27PM (#20731167)
Another question that has not be answered sufficiently: Would the guy you ended up not hiring actually have been a great hire? Everyone panics about / focuses on eliminating false positives and nobody studies or investigates the false negatives.
Re:Tech Interview Handbook by JabrZer0 on Sunday August 18, 2019 @02:20PM (#20731881)
I have no data to back this up, but my expectation is that this is mostly a result of two things:

1. It's often surprisingly difficult to fire an underperformer (anecdata: a friend of mine has lost multiple talented members of his team in the past few months - all the result of having to work with one completely unqualified person. For some reason, the other person has not been fired). As a result, a bad hire can have an outsized and lasting effect on a company.

2. Unless you're looking at very senior positions, there are almost always more people available to fill a role. You may miss 9 out of 10 people who would be effective in the role, but you only need to hire one person.

The math changes a bit when you look at the mythical 10x developer, so maybe it would be worth looking into false negatives specifically in that case. Still, getting that 10x dev would be much more important in a more senior position.

Re:Tech Interview Handbook by novok on Sunday August 18, 2019 @01:39AM (#20728452)
It’s also very subjective and hard to train for or to audit externally. When a company gets too big, you can’t properly vet hiring personally anymore, so you have to scale it.

You don’t want ‘bozo cliques’ to form, so you make a semi-objective process like ‘solve this algorithmic question’ as part of the interview loop. I think execs and the founders doing a final review before hiring all engineers comes from that fear.

Then other companies cargo cult interview processes from larger companies and the trend propagates.

If you want to ‘hack hiring’ as a smaller company, you should use hard to scale processes like the one described in the parent post.

Re:Tech Interview Handbook by rimliu on Sunday August 18, 2019 @05:59AM (#20729292)
Well, if you get too big to get things done well, maybe not get too big?
Re:Tech Interview Handbook by newjersey on Sunday August 18, 2019 @06:37AM (#20729419)
> Well, if you get too big to get things done well, maybe not get too big?

I love this idea but my old history professor (who I pretty much disagree with on everything except this) used to always say "follow the money". What are the incentives that all the parties have for and against growing companies bigger?

Re:Tech Interview Handbook by wincent on Sunday August 18, 2019 @06:06AM (#20729319)
These questions should definitely be part of the interview process, but not all of it. I've done a lot of these kinds of interviews and I've definitely seen candidates that speak impressively but fail basic technical tests.

If you don't actually verify the technical problem-solving ability of the candidate in some way you're forgoing signal that can massively increase the confidence you can have in your decision.

Re:Tech Interview Handbook by ritchiea on Sunday August 18, 2019 @07:16AM (#20729545)
I’ve failed technical tests because I found the interview process stressful, or felt nervous or uncomfortable in the moment or was having a bad day. I recently did a round of interviewing for jobs and realized the real key for me was handling my emotions in these situations so I can bring the same approach I bring to my work to the interview. And it’s not the same as your day to day work because if I’m writing an algorithm or solving a problem at work finding the solution usually happens in my head rather than out loud. This difference is meaningful.

After a few bad interviews I got the hang of it and aced a couple algos interviews. I’ve worked as a developer for 8 years, have tons of software in production, have some open source contributions and have worked productively on several teams.

Interviewing is a skill. I understand why a company wouldn’t hire someone who doesn’t pass a programming test but failing a programming test doesn’t mean you can’t do the job.

Re:Tech Interview Handbook by ummonk on Sunday August 18, 2019 @01:00PM (#20731373)
Yeah, I consider the demand for people to talk out loud during algorithms interviews to be an anti-pattern. It is something I can do (albeit with some difficulty) and excel at interviews as a result but I know engineers who are great at algorithms and at normal design communication who fail interviews because the interviewer doesn’t like their frequent silence while thinking or coding.
Re:Tech Interview Handbook by mandeepj on Sunday August 18, 2019 @11:13AM (#20730628)
> was having a bad day

Then ask for a reschedule or try to get it as the first thing in a day.

> I found the interview process stressful, or felt nervous or uncomfortable in the moment

Need to grow confidence. Walk into interview - like you own it. You are the best. Think - you know everything {only during interview :-) } but also keep an open mind. Don't think - it's an interview - take it as you are going to teach them about what they will ask.

Irrespective of this - mistakes will happen. Fail -> learn -> try again.

Re:Tech Interview Handbook by sieabahlpark on Sunday August 18, 2019 @06:33AM (#20729405)
Anecdotal but we've hired an engineer who was pretty decent in the interview but couldn't figure out how an if statement worked in a legacy codebase.

Yes, I wrote that right. He struggled to understand conditionals in general when building his own logic. The guy even had a masters degree.

Re:Tech Interview Handbook by bakuninsbart on Sunday August 18, 2019 @07:46AM (#20729644)
So I had the same problem for a while, it was quite absurd, because I got through my uni courses, could decently code in Haskell and some other things, but never figured out the appropriate position to put an if clause.

I then did a course on assembly programming and having to be extremely structured and using jump statements actually helped me a lot in easier to use programming languages.

Point of this comment is that people might be good at a lot of things, while just having some weird brainfuse related to a very specific thing. That said, not using if statements makes programming rather difficult.

Re:Tech Interview Handbook by sieabahlpark on Sunday August 18, 2019 @03:55PM (#20732429)
No see I wish they had any redeeming skill, he always asked an engineer to assist him with anything. They couldn't figure out anything on their own. It was shocking someone could complete the interview (small problem with a solution that is essentially explained, make x do y) and completely fail at building their own solutions without guidance
Re:Tech Interview Handbook by Jach on Sunday August 18, 2019 @01:03PM (#20731388)
We had an intern once who struggled with initializing a new object at a root component's initializer in file A, passing it down to the initializer in a child component in file B (required adding to a dictionary object also in A), and extracting and passing it down again to a child-child component's initializer in file C (required adding a new argument to that function, either the param itself or a dictionary object to follow convention) and extracting it for use there. Later I realized the issue was the person's prior experience had been on small programs, mostly written entirely by themselves, and thus they were able to keep them entirely in their head. Since then all my technical interviews try to additionally answer "can you reason about and make changes to code you didn't write, whose entire body is big enough you can't fit it all in your head at once (at least in the amount of time we have)?". A few times I've used a variant of the exact problem I described (of what's ultimately passing data to some nested functions) using simplified code from our codebase. I use a different problem most of the time now, regardless of level, but it's still about modifying existing code and using existing objects rather than cooking up something from scratch.
Re:Tech Interview Handbook by dorfsmay on Sunday August 18, 2019 @09:15AM (#20729960)
Can you elaborate?

What did he do or say that made you think he could do the job even though it looks like he wasn't able to work with other people code?

Re:Tech Interview Handbook by DavidWoof on Sunday August 18, 2019 @12:59PM (#20731371)
Not OP, but there's a group of people who have essentially a good manager's understanding of a project. They understand the trade-offs, they can talk intelligently about technical choices and architecture, and to some degree can even talk about individual modules and classes and language choices.

But they blank at code and struggle with the basics. They get lost for hours at the most trivial bugs. It's weird, but it's very real. Real coding takes a certain kind of abstract thinking that some people just don't have.

Re:Tech Interview Handbook by LanceH on Sunday August 18, 2019 @01:30PM (#20731571)
I have (half?) jokingly said that hiring could be done by selecting people who try to right click something when confronted with a windows task they don't know how to do.
Re:Tech Interview Handbook by mixmastamyk on Sunday August 18, 2019 @08:48PM (#20733988)
I’ve known many smart IT folks that say they don’t or won’t code more than a batch script.
Re:Tech Interview Handbook by baddox on Sunday August 18, 2019 @03:27AM (#20728769)
My immediate reaction is that the problem with that approach is that it’s simply too expensive for the hiring company, in the same way that take-home programming challenges are too expensive for the applicants.

A company trying to hire engineers can easily give a take-home programming challenge to a dozen engineer applicants and take very little time analyzing the submissions. That’s pretty unfair. But it also feels a bit untenable for a senior engineer at a hiring company to have very deep investigations of each applicant’s work history.

Another problem is objectivity. If your company’s engineering hiring process relies heavily on a senior engineer’s subjective impression of an applicant, you’re going to have big problems with your own engineers’ biases, whether subconscious or not. Expect to hear a lot of evaluations like “well, the applicant did seem to have good knowledge and experience, but I just wasn’t impressed for some reason.”

Re:Tech Interview Handbook by EliRivers on Sunday August 18, 2019 @05:36AM (#20729223)
My immediate reaction is that the problem with that approach is that it’s simply too expensive for the hiring company

Is it? The cost of hiring the wrong person can be huge. Not just agency fees if they came through a recruiter (those aren't cheap!), but also all the time people then spend on the bad employee and all the damage that person does before the mistake is rectified.

If this system of reading the resumes and then spending a few hours of senior employee time on an interview can reliably find good employees, that's an absolute bargain.

Re:Tech Interview Handbook by goatinaboat on Sunday August 18, 2019 @09:31AM (#20730023)
The cost of hiring the wrong person can be huge.

This just isn’t true. Every company has a “probation period” usually 3 months where either party can terminate the agreement. That’s more than sufficient to cover this risk.

You don’t pay the recruiter until probation is passed - everyone knows this.

This meme comes from Spolsky who somehow also convinced the world that the hottest programming talent was beating down his door to work on a bug tracking tool for project managers. Maybe his talent was in blogging, and not actually in hiring?

Re:Tech Interview Handbook by sethammons on Sunday August 18, 2019 @12:04PM (#20731012)
> This just isn't true.

Sure it is. People on our team need to take time to onboard the new hire. That's good and expected. The new hire will work slower and that's ok; they will need extra help, time to learn the codebases, etc. After a couple of months, a particular new hire did not work out. Time had to be taken to document reasons, meet with HR, meeting to talk about expectations, etc. In the end, the new hire is gone and so is the time the team spent helping, and the slowdowns on real deliverables, and the hit to team morale. It sucks when someone is let go. It was a net negative for our team and thus the whole org. Depending on a combination of level (leadership position?) and toxicity, negative impact on the team or company culture can occur. Bad hires can have a real cost.

Re:Tech Interview Handbook by boohoojangles on Tuesday August 20, 2019 @03:42AM (#20744648)
This is all true to my experience but not just exclusive to hiring low performers (which I assume is wrong qualifier means here) but also to unsuitable fit, poorly management, failure to motivate a new hire (specially when hiring senior developers), etc.
Re:Tech Interview Handbook by mixmastamyk on Sunday August 18, 2019 @08:52PM (#20734014)
A real cost that can be mitigated by breaking work into smaller chunks at first, and firing quickly.
Re:Tech Interview Handbook by EliRivers on Sunday August 18, 2019 @09:44AM (#20730086)
This just isn’t true.

I believe that to be an incorrect statement, based on my own experience. I have seen companies hire the wrong people and pay the price.

Every company has a “probation period” usually 3 months where either party can terminate the agreement.

I believe that to be an incorrect statement; while I've always seen probationary periods, in this very set of threads "akelly" says that nobody has probation periods. This evidence suggests that "akelly" has never worked at a company with a probationary period (and has foolishly extended their own personal experience into the universal, but that's a separate mistake).

I would also suggest that there is an opportunity cost attached; if someone is fired at the end of their three or six month probation period, the good candidate that replaces them is six months behind.

Some companies end up with drifting dead wood employees; not fired, just moved around from team to team, department to department, because the company makes firing people harder (or more costly to the manager / team-lead) than moving them. This can go on for years. That seems quite a large cost. I've also seen managers simply sideline bad employees rather than dismissing them, for reasons of company politics and face. I've also seen bad hires get promoted, in cases where promoting someone is easier and less costly (to the relevant team lead or manager) than dismissing them; that can be really damaging.

Re:Tech Interview Handbook by james_s_tayler on Sunday August 18, 2019 @08:21PM (#20733859)
>This just isn’t true. Every company has a “probation period” usually 3 months where either party can terminate the agreement. That’s more than sufficient to cover this risk.

Yeaaaah no. I've seen people nope out of a job within anywhere between 30 mins to a couple of months. I've also seen people that knew it wasn't right for them stay 1 to 2 years.

Re:Tech Interview Handbook by ozim on Sunday August 18, 2019 @06:00AM (#20729296)
If it really would be, then current state of things would not go into "making it cheap". I think for entry level employee, or just a regular employee, cost of bad hire is not that high. If turnover on those positions is high, then it also makes things cheaper just to fill in the seat.

I have seen not that brilliant employees that still were earning company money. Just you know "we hire only best of the best" is a scam.

Hiring bad manager or a senior dev, can be bad I agree. So it is not so good to use the same hiring way for seniors and juniors, but unfortunately companies treat senior devs also like juniors.

Re:Tech Interview Handbook by goatinaboat on Sunday August 18, 2019 @02:11AM (#20728557)
This is just how interviewing was done in the 90s

I agree with your approach and use it myself but one thing is different now and that’s the proliferation of tiny skills. Back then you would have a few big skills, you would claim to know one or two main languages, one or two databases and so on. Now people list hundreds - literally hundreds - of skills sometimes. And there’s no way to tell on reading if they really know it, or just saw it once and maybe did a tutorial or “hello world”. People now will add a skill to their CV if they’ve done it for a hour total in their entire lives! Or read a blog post about it. It is a massive time sink to pick through that.

Re:Tech Interview Handbook by jjav on Sunday August 18, 2019 @02:33AM (#20728620)
If we're talking about the same kind of thing, I don't consider those to be skills. For example I've seen resumes which list every javascript library they've ever used. Or every UNIX command they know how to run or similar minutia.

This tells me the person doesn't know the difference between skills and implementation details, so I don't need to proceed to an interview.

Re:Tech Interview Handbook by jishnum on Sunday August 18, 2019 @02:45AM (#20728651)
I'd argue that this is a resume overindexed on getting past recruiting filters looking for specific JavaScript libraries or UNIX commands. Even the recruiters action may not be necessarily bad - startups with a decided tech stack might decide they are not able to provide the time for a new hire to ramp up.

Effectively you penalise not catering the candidate resume to what you are looking for or deem important.

Re:Tech Interview Handbook by rhizome on Sunday August 18, 2019 @05:54AM (#20729278)
Does anybody even know anything about these resume filters? They seem legendary, or I'd think there would be a best practice by now.
Re:Tech Interview Handbook by james_s_tayler on Sunday August 18, 2019 @08:27PM (#20733887)
The trick is there are multiple resume filters.

One will filter you out for having too many keywords. One will filter you out for not having enough keywords. One will filter you out for including a picture. One will filter you out for not including a picture. One will ... ad infinitum

Your resume is being evaluated by different filters constantly. Different filters filter different things. There is no "right" answer. There are only answers you will or won't be filtered out for depending on which filter is being applied.

Which filter is being applied?

It's random.

Hiring is essentially random.

Re:Tech Interview Handbook by detaro on Sunday August 18, 2019 @07:18AM (#20729550)
Various vendors of software in that space claim they are best practice, e.g. IBM: https://www.ibm.com/talent-management/hr-topic-hub/applicant..., https://appsource.microsoft.com/en-us/product/web-apps/cem_b... promotes keyword matching as a feature, ...
Re:Tech Interview Handbook by rhizome on Sunday August 18, 2019 @05:42PM (#20733111)
Oh sure, I know they exist, but on the resume side there's no common knowledge of anything besides keyword stuffing. I'm wondering if that's actuallly the best way given how the filters actually work (which I don't know).
Re:Tech Interview Handbook by kthejoker2 on Sunday August 18, 2019 @03:07AM (#20728710)
Algorithmic HR has ruined any chance you won't see an SEO centric resume ever again.

"I need my resume to show up in your filter, relevance to the actual job functions be damned."

Re:Tech Interview Handbook by bakuninsbart on Sunday August 18, 2019 @07:57AM (#20729674)
As a very fresh junior developer, crafting a CV is extremely exhausting, because it is very hard to gauge what you can put in. Take git as an example: I used it for a couple of personal programs, read part of the documentation, had some errors and managed to get rid of them.

I know the theory of how to use it on large projects. I even know enough to know that I'm pretty much just scratching the surface, but so are probably most other people.

Same with most other skills. At how many lines of code can I call myself proficient in a language? And what if I copied large parts of code from stackoverflow?

All in all I think I spend like 8 hours on writing and formating that freaking thing, and it still just feels like some of my skills are a stretch.

Re:Tech Interview Handbook by Jach on Sunday August 18, 2019 @11:26AM (#20730736)
Skills or tools are keyword dumps, use them as such (which in later revisions may include removing them or moving some to be contextualized in job descriptions). My own rule is to only list things I think I could adequately answer a bunch of random questions on; sometimes you might only realize you couldn't when you meet a line of questioning that totally defeats you. I don't put a proficiency level, if it's present then I'm proficient if perhaps also rusty. (Stating proficiency levels has a tendency to bring the knives out, "advanced" or "expert" begs to be challenged, and something like "mastery in C++" -- is your name Bjarne?)

> At how many lines of code can I call myself proficient in a language?

If you want a target to shoot for, I'll give you one, but don't really follow it... LoC is kind of meaningless on its own in part because it's contextual on many things (you highlighted one context, lines copied, I'll use a different context). 1k lines if paid for them, 6k-10k if not. This doesn't include lines added and then deleted (i.e. if your only project in FooLang weighs 300 lines, it's 300 lines, even if making the project involved adding 100 lines, deleting 50, adding 500 lines, deleting 100, editing 300, deleting ...) you need projects whose sum mass is 1k. Probably better to have at least one 1k+ project too, especially if it's unpaid. But again, don't follow this, it's just a somewhat random target to answer the question. Better to think about what this could be a proxy for, and target that instead.

Re:Tech Interview Handbook by insulanus on Wednesday August 21, 2019 @07:11PM (#20762914)
I've been around the block, and I hope I can give you some perspective from both sides.

I'm glad you brought up git. Source control is central to modern software development. If you don't have it on your resume, someone might think "hmm, have they really done much programming?" But if you do put it, it will obvious from your resume that you are just out of school, so no one is going to expect you to teach a git class.

As a more experienced person, I won't expect you know the internals of git.

Non-technical people screening your resume aren't going to know the difference between you and Linus, though, so you need to put it. Don't worry, it's not false advertising.

If the job description is back-end tooling at Github or Gitlab, I'll expect more. Similar to the difference between knowing how to use a spreadsheet, and having written a spreadsheet.

Now, if it's something crucial to the job,say your C skills writing software for micro-controllers at an embedded electronics company (like what Nest or Pebble used to be). You can't fudge here. Nothing will help but lots of practice.

Good luck!

P.S. For your first job, focus more on figuring out what you want from your working life. What kind of manager, what kind of work, etc. Yeah, you'll need to pick up some buzzwords to add to your resume, but it's not as important as becoming good at the fundamentals of what you are doing.

Re:Tech Interview Handbook by goatinaboat on Sunday August 18, 2019 @10:47AM (#20730426)
You should be able to talk fluently for at least 1 minute about everything you list as a skill. You should have enough material to be able to talk about your CV as a whole for 45 minutes. Not a cast iron rule but this will see you through most interviews. Good luck!
Re:Tech Interview Handbook by bakuninsbart on Monday August 19, 2019 @05:07PM (#20741835)
Thank you, that is an interesting way to look at it, and makes a whole lot of sense! I guess it should be amended by "meaningfully talk about", but I get that from context.

To be honest, the process of writing a CV is mostly painful for me because I have to evaluate myself and feel quite inadequate. At the same time, I have multiple companies wanting me despite not being very good, so my actual chances are really good. Software development in Germany is going crazy at the moment.

Re:Tech Interview Handbook by DavidWoof on Sunday August 18, 2019 @01:51PM (#20731689)
> At how many lines of code can I call myself proficient in a language?

I would say don't use adjectives to describe skill level. I put most languages I have experience with on my resume, and order them descending by how well I know them. I know the stuff at the top pretty well, and it's downhill from there. In interviews I'm very upfront that I'm incredibly rusty with the stuff on the bottom of the list, and interviewers understand and accept that.

The exception is if you feel comfortable putting "advanced" or "expert" on one of those, but then you had better be able to back it up.

LOC is a bad measure of proficient. I would say you're proficient if you can write a simple program without looking up syntax and relying only on autocomplete for library references.

Re:Tech Interview Handbook by toupeira on Sunday August 18, 2019 @08:40AM (#20729836)
I just use a table with experience level columns like e.g. "Proficient", "Advanced", "Hobbyist". But use categories that make sense to _you_ and your skillset.
Re:Tech Interview Handbook by mizzao on Sunday August 18, 2019 @09:09AM (#20729937)
This works for non-technical positions too. Generally it requires an experienced interviewer to listen to the candidate, think on their feet, be fully engaged, and basically do the opposite of the one-size-fits-all coding or behavioral interview.

It takes a lot more effort on the part of the interviewer and is "harder to scale", in that you can't just train people to ask canned questions. But since it's open ended, it's a lot better at finding out what the candidate is really good at, and it's very useful to have one of these in every hiring loop, usually by a senior team member or exec.

Re:Tech Interview Handbook by supercanuck on Sunday August 18, 2019 @06:10AM (#20729329)
>It is, however, vital that the interviewer must be a expert in the field.

This is key. There are a lot of hiring managers masquerading as experts and are frustrated when cargo culting hiring processes falter and lack the people skills to diagnose a situation. You'd also be amazed at the quality of resumes a high, advertised salary will bring.

Re:Tech Interview Handbook by nvarsj on Sunday August 18, 2019 @11:54AM (#20730945)
> You'd also be amazed at the quality of resumes a high, advertised salary will bring.

This is so true. The best devs are making above market rate and are busy and content with their current role. By not including salary most of these people will simply ignore you, because of the time risk involved in finding the number. Non disclosure only works if your salary ranges are generally known (eg faang).

Re:Tech Interview Handbook by jakebasile on Sunday August 18, 2019 @01:40AM (#20728453)
These are the kinds of interviews I love, and I appreciate that they're still given at some places. I agree, it's nearly impossible to bullshit your way through this kind of a conversational interview but people still think they need to ask trivia questions.
Re:Tech Interview Handbook by kls on Monday August 19, 2019 @02:56PM (#20740657)
Been doing it the same for over 20 as well, only had one bad hire and it had to do with drugs and attitude more than skill set. He was a good developer and was sober when I hired him but fell off the wagon and started missing work, no showing etc. I fully concur that if you can't spot a competent developer from a conversation, you probably should not be in the position of evaluating potential developers.

I don't disagree that there are a lot of fake it till you make it developers who did a vo-tech class and are applying for jobs out of their league, but I just don't know how people don't spot them. It takes me about 5 phone calls to find a competent individual, and then I bring them in for a in person. As a hiring manager, I don't find it cumbersome to weed thru 5-10 people to find a good hire.

Re:Tech Interview Handbook by thedufer on Sunday August 18, 2019 @05:13AM (#20729141)
> I can say that I've never regretted a hire I said yes to, so the method works to my satisfaction.

You think this is a claim about how good your hiring practice is, but the only way I can think to read this is as a point about how little hiring you do or how little evaluation of hires you do. In the real world, perfection isn't possible, so claims of it are a sign of inexperience or naivete.

Re:Tech Interview Handbook by marliechiller on Sunday August 18, 2019 @05:27AM (#20729191)
you're misconstruing perfection with satisfaction. entirely different things
Re:Tech Interview Handbook by lolptdr on Sunday August 18, 2019 @01:35AM (#20728435)
Thank you for your refreshing point of view. I'm a mid-level software developer and I was on the other side of the table as a junior web developer and encountered this same style of questioning and embraced it. This is my go-to style when interviewing because if you are confident in the lingo and zeitgeist of development, there is no way they can bullshit there way and lie through their teeth on their own experiences. It is very easy to tell. Whiteboarding doesn't give that detection since it is too broad of a spectrum to start as a indicator of experience.
Re:Tech Interview Handbook by rimliu on Sunday August 18, 2019 @06:02AM (#20729299)
Exactly. If you were really working with the stuff you do you will know all the common pain points, workarounds, etc. Unless the interviewer is alien to those things themselves there can be instant "one of us" recognition.
Re:Tech Interview Handbook by virgilp on Sunday August 18, 2019 @03:11AM (#20728721)
> I can say that I've never regretted a hire I said yes to, so the method works to my satisfaction.

This may just mean that you say a lot Of wrong “No”s. To get very high precision or very high recall is really easy... what you must measure is your F-score

Re:Tech Interview Handbook by norcalli on Sunday August 18, 2019 @03:16AM (#20728736)
The regret metric is different for a false "no" compared to a false "yes." I'd rather say "no" to someone who could've been great than "yes" to someone who wasn't, so I would say that it isn't that important.
Re:Tech Interview Handbook by virgilp on Sunday August 18, 2019 @03:36AM (#20728788)
Depends a lot on the company and situation (how easy is it to fire a bad hire? Does the company do it?) - but you can use something like F2 or F0.5 where relevant.

Remember Facebook rejected Brian Acton, and paid billions for that. An oversimplification, I agree, but the larger point is that people tend to dismiss too easily the impact of bad “no hire” decisions, compared to the bad “hire” decisions. Just because you can’t or don’t measure it, doesn’t mean that the impact may not be arbitrarily large.

Re:Tech Interview Handbook by ryandrake on Sunday August 18, 2019 @12:51PM (#20731325)
This comment boils down precisely what I’ve always thought is the key problem in tech hiring. Companies overestimate the cost of a bad hire and underestimate the benefit of taking a risk and having it pay off.

To borrow from poker: it’s commonly understood that if you’re not “caught bluffing” at least a little, it means you’re not bluffing enough. If your hiring process results in zero bad hires, you are playing it way too safe and I guarantee you are missing out on phenomenal candidates.

Re:Tech Interview Handbook by DavidWoof on Sunday August 18, 2019 @01:33PM (#20731588)
I think you're wrong. I think companies are completely correct in assessing the cost of a bad hire to be much greater than the loss of a good hire, assuming you're getting enough good hires to fill the positions available.

Now, this assumes that you're not missing out on great hires; in other words, it assumes that the good hires you miss are at the bottom of your hiring range. Your point might be that this can't be guaranteed, and while that may be true, it's unlikely that any tweaks to a given hiring process are going to bring them in either.

Re:Tech Interview Handbook by KKKKkkkk1 on Sunday August 18, 2019 @10:57AM (#20730500)
I'm an engineer and my contract is very explicit which parts of my work I'm allowed to speak about. The answer to all your questions will be "I can't speak about it." That's precisely why Google interviewers always ask abstract puzzle questions and avoid like fire any possibility of being exposed to protected IP.
Re:Tech Interview Handbook by sbarre on Sunday August 18, 2019 @11:09AM (#20730595)
There are definitely ways to talk about your work experience in enough detail without breaking NDAs..

I would be honest and say "I'm under NDA for a lot of that but I'll do my best". If neither of you are jerks, you should be able to manage it.

Re:Tech Interview Handbook by darkerside on Sunday August 18, 2019 @07:25AM (#20729579)
> I can say that I've never regretted a hire I said yes to

Have you let new hires go in the first 90 days? That's just one of the ways personal regret is probably not the best metric here.

Re:Tech Interview Handbook by warlog on Sunday August 18, 2019 @08:12AM (#20729727)
If you haven't hired any people that you regretted (ultimately), I wonder if you're being too conservative in your hiring? Sure you don't fail, but are you ever surprised that a marginal borderline outside the box case turned out to be 100x ?
Re:Tech Interview Handbook by closeparen on Sunday August 18, 2019 @03:32PM (#20732295)
>If the person described in this resume fits the background experience the role needs, you get an interview.

This is one way the current status quo might be better than the past: you don't get pigeonholed so much by your past experience into being a "fit" only for similar roles. Sometimes the hiring manager is really looking for a specialist, but in general, we don't care what industry you were in or what tools you were using, as long as you can prove you're smart. Some of the most impressive people we have working on Go microservices were enterprise C# developers before.

Re:Tech Interview Handbook by Aperocky on Sunday August 18, 2019 @07:39PM (#20733661)
I think fizz-buzz is still an appropriate screen.

While it maybe easy to hire dev who have been on the market for 10 years. You still have to keep in mind that new developers are still a very large proportion of the dev population.

Re:Tech Interview Handbook by sh87 on Sunday August 18, 2019 @12:52PM (#20731332)
This form of interviewing requires a certain degree of skill and lots of experience to keep the conversation objective and on track. I don't have that. I rely on a base technical question based on the candidate's past projects and then go on from there.
Re:Tech Interview Handbook by non-entity on Sunday August 18, 2019 @01:17PM (#20731488)
This is how much of my interviews have been and how I wish (however unlikely) my future ones will be. Unfortunately I rarely get to the interview stage of things as my resume is filtered out
Re:Tech Interview Handbook by sharadov on Sunday August 18, 2019 @10:52PM (#20734511)
I absolutely agree, as an interviewee that's what I focus on, and you're right you can catch it if someone is bullshitting.
Re:Tech Interview Handbook by zerr on Sunday August 18, 2019 @02:52AM (#20728669)
I wonder if there is a list of companies doing interviews this way.
Re:Tech Interview Handbook by norcalli on Sunday August 18, 2019 @03:23AM (#20728758)
I use the same technique (and I'm 26 now, so relatively young) and it's how I've always interviewed others. Granted, I've only worked at smallish startups, but, either way, the company didn't care about my technique for evaluation, and just my final "yes", "no," or "maybe." So, I think it depends on the engineer.

If someone can keep up in a technical conversation about their background with me and answer every question I have about a technical project they did, then basically they pass. It works especially well even if I'm not familiar with their project, because I have an opportunity to learn, so I can ask any question that comes to mind until they teach me what they learned.

I did hire someone that I regretted, though, but to be fair, this was among my first interviews. The mistake I made was getting too easily caught talking about programming and technical things without specifically diving deep into his past project. He and I vibed quickly and I liked him, and that felt like enough, but after only a week it seemed obvious that he wasn't going to be producing much code, and we let him go. Otherwise, I've been happy and my ability to discern has only gotten better as I became more experienced.

I got a little offtopic, but my main answer to your question was "if the company leaves the decision up to a majority of engineers saying 'yes', then a lot of companies do this." Google does this, the startups I've worked at do this, and some of my friends companies do this.

Re:Tech Interview Handbook by Jach on Sunday August 18, 2019 @01:20PM (#20731507)
Not exactly that, but you might like to peruse https://github.com/poteto/hiring-without-whiteboards

Reader beware, of course, I know at least one company on there shouldn't be.

Re:Tech Interview Handbook by zerr on Sunday August 18, 2019 @06:54PM (#20733467)
Oh, I see, they use the term "whiteboard" as a synonym for leetcode-like riddles.
Re:Tech Interview Handbook by new299 on Saturday August 17, 2019 @11:10PM (#20728001)
Personally I can't see an issue with very simple FizzBuzz style programming interview questions. I used to ask a simple "count duplicate substrings" question [1]. Maybe some people consider this too hard? I never used to require exact syntax, and would have been happy with pseudo-code. Using libraries is fine etc..

I also found very few people could solve this (similar non-SF large city location). Occasionally, people who could not solve this were hired for other teams. Based on their performance, I don't think I would have been comfortable working with them.

I don't think it's unreasonable. But I'm not sure I'd use it as a screen if I was hiring now. I think I'd just have a chat and try and discuss a previous project. After that I'd move to a paid take home project (ideally representing real, useful work).

[1] Take a string, for example "ABCCABC" and count the number of times each 3 character substring occurs. In this case the answer would be 2xABC 1xBCC 1xCCA 1xCAB.

Re:Tech Interview Handbook by bradlys on Saturday August 17, 2019 @11:46PM (#20728114)
I never had any technical interview prep when I started. I could code just fine. I demonstrated that at my other jobs and in school well enough. Then I started interviewing for SF positions that did these interviews.

I froze up. I couldn't talk and think at the same time. I didn't have the skillset for doing this in a very intense scenario. In my case, I was homeless and needed a job ASAP. Every interview felt like life or death to me.

First one I was asked to reverse a string in C. I hadn't done C in a few months. I froze up on syntax. I looked like an idiot who couldn't do it.

I could imagine many people who have never experienced this format (or haven't experienced it much) would easily freak out and look stupid as bricks like I did.

I've since done over 200 technical interviews (as the interviewee) and I usually sweep. Still fail at FAANG but I always get the solutions. (Even the leetcode hard ones) Just not sure why I fail but cest la vie.

Re:Tech Interview Handbook by DavidWoof on Sunday August 18, 2019 @01:13AM (#20728373)
Whenever I ask coding problems during an interview, I emphasize any language at all including pseudocode. And if they still struggle, I ask if they could just walk me through it verbally and we can work out the syntax together.

I realize people can still freeze up, but at some point I think there's just no solution to that unless the candidate can produce a significant portfolio. Also, I read your post and it sounds to me like to gained confidence in this area as your coding skills improved, which I don't think is as much a coincidence as you seem to believe.

Re:Tech Interview Handbook by new299 on Sunday August 18, 2019 @12:25AM (#20728224)
This is a really interesting observation, thank you.

Is there anything they could have done differently to make the situation easier? (I would guess perhaps giving you more notice about language requirements?). Or is there a different interview format that you feel would have worked better?

Re:Tech Interview Handbook by mixmastamyk on Sunday August 18, 2019 @01:06AM (#20728351)
Not really, innovative thought can’t be done with a gun to your head. Perhaps if you’d written this code multiple times over the years and had it memorized. But, that won’t help with random problem #2.

Stick to the basics and a trial period.

Re:Tech Interview Handbook by new299 on Sunday August 18, 2019 @01:12AM (#20728366)
Is reversing a string not already "the basics"? What are you suggesting should be covered in an interview/screen prior to a trial period?
Re:Tech Interview Handbook by mixmastamyk on Sunday August 18, 2019 @03:14PM (#20732209)
Your question was not reversing a string. You also mentioned fizzbuzz.
Re:Tech Interview Handbook by new299 on Sunday August 18, 2019 @07:13PM (#20733554)
It’s the problem under discussion in the post you are replying to.
Re:Tech Interview Handbook by mixmastamyk on Sunday August 18, 2019 @09:19PM (#20734149)
I was referring to your [1] in this thread.
Re:Tech Interview Handbook by lacker on Saturday August 17, 2019 @11:20PM (#20728026)
Of course some people will consider that question to be too hard. But you may not want to hire those people. The point of an interview process is for you to pick the people you want to hire, not to ask questions that everyone agrees aren’t too hard.
Re:Tech Interview Handbook by new299 on Saturday August 17, 2019 @11:35PM (#20728084)
I'm curious to hear the opinions of people who think that the question is too hard (i.e. it's too complex of a question to ask in an interview situation).

Perhaps some people might feel that while they could write code to solve this problem (or similar problems) outside of an interview. However, under the pressure of an interview they would not be able to solve the problem (due to anxiety, stress etc.).

If that was relatively common, then such a question would not be a useful interview question. Or would at least not be giving an accurate estimate of a candidates programming ability. This seems unlikely to me, but I would be interested in hearing different view.

Re:Tech Interview Handbook by bpchaps on Saturday August 17, 2019 @11:47PM (#20728120)
The fizzbuzz test is not entirely about whether someone can do it. It's also about figuring out the style of the programmer. There's a surprising amount of flexibility to fizzbuzz; how is user input handled? Do they use a linter? How are variables managed/named? There's a lot going on, and it can be gamed just like anything else on both ends.

That said, the last time I had a fizzbuzz take-home test, it was infuriating -- my code is online.. what does fizzbuzz prove except to help make a company soc2 compliant?

Re:Tech Interview Handbook by DavidWoof on Sunday August 18, 2019 @01:02AM (#20728343)
No, a fizzbuzz test is entirely about whether somebody can do it. That's the definition of a fizzbuzz test. When you hear others talking about a fizzbuzz test, they're not talking about the specific algorithm, they're specifically talking about a simple single-function problem that should take no more than 5 or 10 minutes.

If you're dealing with user input or linting, then that's not a fizzbuzz test. I'm not doubting that maybe somebody asked you to do something larger than that including the fizzbuzz problem, I'm just saying that nobody else here is talking about take-home problems when we talk about fizzbuzz.

Re:Tech Interview Handbook by new299 on Sunday August 18, 2019 @12:12AM (#20728192)
I guess it depends how you use it. I started hearing about FizzBuzz in the context of "why can't programmers program" [1]. I.e. that many interview candidates can't solve this problem.

It's also my experience interviewing programmers (outside SF) that most candidates can't solve simple FizzBuzz style questions. As a take-home test, I agree I can't really see the value in it.

[1] https://blog.codinghorror.com/why-cant-programmers-program/

Re:Tech Interview Handbook by ryandrake on Sunday August 18, 2019 @01:00PM (#20731377)
Back when I did phone screens, I went even simpler: Write a program that counts from one to ten, printing each number out followed by your name followed by a newline. Do not print the line for number 4.

It’s astounding how many programming candidates can’t work their way through this.

Re:Tech Interview Handbook by james_s_tayler on Sunday August 18, 2019 @08:43PM (#20733968)
Also astounding is the number of programmers who program over the phone. Approximately zero.
Re:Tech Interview Handbook by itronitron on Sunday August 18, 2019 @01:32PM (#20731580)
a nested for loop is certainly not hard ... however ... they describe the problem as something we thought was a trivial nested for-loop problem which suggests that maybe it wasn't. if the problem was presented in a more abstract fashion, such as print all filenames 'within' a directory, then a candidate may have stalled on which approach to take.

also, someone who has only ever written code using lambda expressions might have difficulty writing a nested for loop

Re:Tech Interview Handbook by PeterisP on Sunday August 18, 2019 @05:12AM (#20729133)
Your problem actually is a good illustration of the whiteboard test problems.

I just tried it, and it was trivial to do in a minute or two on my laptop. However, I did took note of two syntax mistakes that I made in the python REPL that were immediately obvious there and took seconds to fix, but which I most likely would not have noticed on a whiteboard.

So there's quite a bunch of problems where if the acceptable "format" of the answer is "hey, I'll just pull out my laptop from the backpack and push the solution to github in 15 minutes" then it'd be okay, but it'd be hard to do it while 'whiteboarding' without access to immediate feedback and easily accessible API documentation.

For example, I work in many languages, and for many APIs I can't remember whether in this particular language the same thing is called add or append or something else; e.g. I've worked on Java code for a dozen years and would be a quite productive Java developer, but since I haven't written any new code in Java for quite some time recently, I can't remember off of my head what's the right boilerplate to open a text file for reading in Java - it's something that a Java tutorial might have in the first pages right after Hello world, but I'd still have to look up the incantation to pass the encoding properly - there's like three Reader classes to instantiate and I don't recall their names off the top of my head.

Re:Tech Interview Handbook by deanclatworthy on Sunday August 18, 2019 @08:49AM (#20729867)
Nobody is punishing trivial syntax errors in whiteboard interviews. Nobody is taking your code and checking it runs.

It’s about your approach to problem solving and your ability to communicate that.

Re:Tech Interview Handbook by JustSomeNobody on Sunday August 18, 2019 @12:34PM (#20731213)
Is this really true though? I mean, I've been in development long enough to know that people go just plumb ape shit over the silliest things.
Re:Tech Interview Handbook by davidjnelson on Sunday August 18, 2019 @03:41PM (#20732348)
A cs professor at Stanford that hired at google said they _absolutely_ care if your code compiles and works correctly. This is the “coding fluency”[1] metric. The author of cracking the coding interview also touches on this.

1. https://www.programmercoach.com/2017/04/interview-insider-co...

Re:Tech Interview Handbook by new299 on Sunday August 18, 2019 @06:14AM (#20729342)
Do you think you could rough out an answer on a whiteboard that would have roughly the right structure?

When I used this question I wasn't looking for accurate syntax. If it was a solution that looked like it would work, after some debugging etc. I'd consider that a pass.

Regardless most people couldn't answer it, which I considered surprising.

Re:Tech Interview Handbook by PeterisP on Sunday August 18, 2019 @06:33AM (#20729408)
Sure, the structure is obvious; one was an issue of a method being named differently than I remembered, the other was an off-by-one error that'd show up in testing.
Re:Tech Interview Handbook by new299 on Sunday August 18, 2019 @11:58AM (#20730973)
So, it wasn’t obvious to many candidates I interviewed. For example, one candidate tried to create a solution involving 3 nested for loops.
Re:Tech Interview Handbook by itronitron on Sunday August 18, 2019 @02:00PM (#20731757)
Assuming these candidates already made it past an initial filter it would be interesting to ask the filtered out applicants the same question and see how well they do
Re:Tech Interview Handbook by b3b0p on Monday August 19, 2019 @02:30PM (#20740375)
I also was able to solve it in a couple/few min after seeing the comment. I did have a couple issues, index was off by one, and didn't catch an issue if I had already seen the substring using a brute force nested loop, but otherwise it works (Python). Edit: I also did it without a nested loop using a dictionary. Why I didn't think of this initially I don't know.

I've also had a couple FAANG onsites and get nervous as can be, but that's just a practice more and be more confident with my abilities problem I feel. No offers though yet. Still trying and practicing.

Re:Tech Interview Handbook by tempguy9999 on Sunday August 18, 2019 @08:15AM (#20729740)
If I were with you I'd not necessarily write anything.

Id put out my fingers 3 characters wide to the first substring and step through the rest of it in 3 char 'spans' with my fingers. I'd say "extract each substring, put it into a map with that substring as the key and either 1 as the value if it wasn't already present, or if it was, increment the value"

I'd probably not bother mentioning how to extract the results unless asked.

If someone said that to me it would show the solution, and I'd be 100% happy.

I'd assume that they could then render that into code - perhaps that would be a mistaken assumption though but in my experience solving the core problem is the thing I'm interested in, not the syntax. But those with more experience may say the former doesn't always imply the latter, and the code needs to be shown.

Re:Tech Interview Handbook by jameshart on Sunday August 18, 2019 @10:09AM (#20730208)
The translation to code is important. I have seen people who can describe a solution like that but when they come to write it as code struggle with managing simple mutability/immutability, scope, iteration, and conditional execution concerns. Better basic ability tests include a problem that requires an explicit nested iteration, because some people seem to struggle juggling two loop contexts in their head at once.

What I struggle to understand is why this sort of thing still serves as a useful weed-out screen in our industry, even for people whose resumes indicate masters degrees and multiple years of experience in development organizations. But experience shows that there really are people who are ‘faking it’.

Re:Tech Interview Handbook by lifeisstillgood on Sunday August 18, 2019 @03:42AM (#20728807)
That beats fizzbuzz for me - I think I shall steal it. It's simple enough that it can be done in five minutes but it has enough edges that people could go down the wrong rabbit hole
Re:Tech Interview Handbook by kidintech on Sunday August 18, 2019 @07:45AM (#20729643)
Am I misunderstanding your problem, or would this be a valid solution: https://pastebin.com/GWKr4AQ8

If so, then the company you're interviewing for must not be attractive to first-class CS grads (top 10-20% I think) from any non-online university.

As a comparison, any FAANG + Palantir/Jane Street/Two Sigma in the UK have tougher questions as their FIRST phone interview for INTERNSHIPS. (Palantir requires you to go through 6-8? interviews before getting an offer)

If this is a job that requires actual software engineers, I think rejecting everyone that failed this question would be perfectly reasonable.

Re:Tech Interview Handbook by new299 on Sunday August 18, 2019 @09:36AM (#20730039)
Yes, that looks like a valid solution to me.

If you’re saying only the top 10-20% of CS grads can answer such questions then that would make sense. I’d guess I was getting a random selection of candidates.

Re:Tech Interview Handbook by kidintech on Sunday August 18, 2019 @09:51AM (#20730126)
> you’re saying only the top 10-20% of CS grad

I'm saying that ALL top 10-20% of CS grads will be able to answer questions at this difficulty level in an interview scenario (accounting for nerves and so on). I'm not limiting it to them (i.e. the "only" quantifier).

I know people in the bottom of CS grads (judging by GPA) that worked remote jobs or worked on personal projects during uni that are very talented and would be able to solve this in less than five minutes. But there are also people that merely "got by".

> I’d guess I was getting a random selection of candidates.

I stand by my opinion that if you were recruiting for a software eng role (and not some random front-end position), then blacklisting anyone who failed this problem would be reasonable.

Re:Tech Interview Handbook by twic on Sunday August 18, 2019 @10:21AM (#20730264)
+1. Anyone who is a programmer can solve that problem. If they can't solve it, they aren't a programmer, end of story.
Re:Tech Interview Handbook by new299 on Sunday August 18, 2019 @11:14AM (#20730639)
So the weird thing is, that people who can’t solve these kinds of fizzbuzz type problems are often employed as programmers.

And, in my experience there are definitely situations where the majority of candidates can’t solve these problems.

Re:Tech Interview Handbook by twic on Sunday August 18, 2019 @11:58AM (#20730971)
Right! I can think of two explanations for this.

One, these non-programmers are somehow not actually doing their jobs, but getting away with it. I've worked with people like that, but only a tiny number. Maybe i've been lucky.

Two, you don't have to be a programmer to be a developer. In this day and age, our tools, frameworks, and resources (ie Stack Overflow) are developed enough that you can actually get some useful things done without having to think mechnically. Knowing some obscure boilerplate (eg Spring annotations), how to use your IDE's autocomplete, and where to go for copy-and-pastable code for various kinds of problem actually makes you a useful team member! Even if you can't write a simple loop to save your life!

Re:Tech Interview Handbook by new299 on Sunday August 18, 2019 @11:12AM (#20730622)
Good to know, I would tend to agree. I’m interested in any contrary opinions (because I may not sufficiently account for anxiety, or other issues).
Re:Tech Interview Handbook by Jach on Sunday August 18, 2019 @02:00PM (#20731752)
It's not an unreasonable problem, but one way to smooth it out could be to provide a list of "potentially helpful" string functions relevant to the variety of ways one might solve this problem. Not all string libraries are equal among programming languages, and recognition is easier than recall. I guess it really depends what you want to measure with the problem though. I use a problem that at the end of the day requires them to output an edge (start point, end point) that is used to feed a line drawing routine. I provide the standard junior high formulas for euclidean distance, mid-point, slope, inverse-slope, and two ways to represent a line, since I'm not testing for remembering those, but whether a subset of them can be used to solve the problem. I've still run into candidates who seemingly had never modeled a line mathematically before, and found myself hastily trying to explain how one would do so, like I were giving a lecture to a junior high student for the first time in pre-algebra. Needless to say they weren't able to then program a solution, or anything at all really... They would have been filtered out by your problem in less time. I think your problem could also be made easier to filter out the same people faster, but from my standpoint, I'm usually mandated by policy that I'm going to spend an hour with the person, so I try to make my problem answer a bit more than just the basic "can you code at all?"

Do you get candidates that ever ask "can I assume the strings are ascii?" The usual solutions to this will break in amusing ways if you allow arbitrary unicode. I know some interviewers who actually would have as a hidden scoring criteria "candidate asked about input encoding", and a lack of asking about that is a fail even if they correctly solve the problem for ascii. I myself disagree with using such hidden criteria -- if I'm going to score something, and not tell the candidate what exactly I'm scoring, it's at least going to be something in the code like "correctly avoided the divide-by-zero case without me pointing it out" and not an expectation of the candidate to read my mind on my expectations of things I haven't told them. (I do tell them to try and write code without errors (I help fix up basic syntax quirks or if I spot a typo I'll point it out), or ask how confident in their code they are and whether they might have in mind any edge cases to try -- I'd like to get a candidate who actually writes a unit test on their own, I always point out junit is set up...)

Re:Tech Interview Handbook by lkbm on Sunday August 18, 2019 @12:28PM (#20731172)
That seems like a nice, easy puzzle someone should be able to do on a whiteboard, but I think it would work better on a computer -- my first iteration of this included a bug, as well as some print statements intended help detect and diagnose bugs. I could carefully think through the problem to ensure I get all edge-cases/bugs, but I do better playing with it interactively. (In this case, my first iteration included 'BC' and 'C' as substrings each occurring once.)

You see my process better if you watch me write and correct this program on a computer. If my tasks is to think up a fully correct solution without iterative trying incorrect solutions, you're missing an important part of my process, even with a trivial FizzBuzz. (Though with this one you could probably just act as the interpreter and point out the errors for me.)

Re:Tech Interview Handbook by abhishekjha on Sunday August 18, 2019 @08:31AM (#20729805)
>Take a string, for example "ABCCABC" and count the number of times each 3 character substring occurs. In this case the answer would be 2xABC 1xBCC 1xCCA 1xCAB.

Can be done in O(n) time with a hash table.

Re:Tech Interview Handbook by andrewstuart on Saturday August 17, 2019 @11:07PM (#20727988)
>>> how you think it should be done. Because I have to admit I'm pretty much lost right now.

- Treat recruiting in the same way as you do software development.

- Formulate a set of requirements.

- Define interview questions that give insight into whether or not the candidate meets those requirements. This is the equivalent of "tests" in the software process.

- Specific skills with your technology stack is good, but not necessarily essential.

- Ability to discuss sophisticated software concepts, and to explain software that they have built, and how they would build out ideas given to them is good.

- Evidence that this person gets stuff done is good (ref Joel Spolsky).

Coding tests are, for the most part, garbage. Not because the test is of no value, but because you the employer probably don't evaluate the result properly.

Re:Tech Interview Handbook by worble on Sunday August 18, 2019 @09:34AM (#20730032)
While I can't say anything from the prospect of an interviewer, as an interviewee I am a big advocate for this style. Give someone a set of requirements, and then talk through how they would solve it. Allow for further clarification, and just talk about tech. It's a little more unstructured and less formal, but surely you'll very quickly pick up what experience they have, whether or not they've made past solutions that'll fit, what new technology they'd like to use, what technology they'd end up actually using, and there's no set right or wrong answer. The interviewer might even end up learning about something they themselves weren't aware of.

If someone could blag that while not being able to even write FizzBuzz, all I can say is well played to them.

Re:Tech Interview Handbook by dccoolgai on Sunday August 18, 2019 @08:00AM (#20729682)
1) Resume screen 2) 30-minute coderpad/codeshare exercise on a problem/pattern you actually use/encounter during the course of your work over phone. (No inverting binary trees). Expect a 20% pass rate here. 3) Reasonable take-home problem that you've timed 2 of your own staff completing well in 50 minutes. This is where you will get the most complaints from applicants, but that's OK. Let them select themselves out of the process. Expect a 30-40% pass rate here. 4) In-person interview. At this point, you should be mostly committed to hiring the candidate. Do a couple livecoding deals, but be extremely lenient in how you interpret results. Other week, we had a candidate fail the problem, but they kept their composure and showed they knew what they were doing on the way to bombing the problem. Candidate seemed sad at the end of the interview and happily surprised when we extended an offer.

IMHO this process works fairly well and does a good job of being economical with people's time.

Re:Tech Interview Handbook by mjfisher on Sunday August 18, 2019 @01:51PM (#20731686)
I'm curious about the codepad/codeshare approach right at the first touch point. I fully agree that screening actual tech skill early on is important. Do you not find that you commit a lot of engineer time to codeshare interviews that don't work out further down the line?
Re:Tech Interview Handbook by dccoolgai on Sunday August 18, 2019 @04:01PM (#20732459)
Codeshare portion is 1 (typically senior) engineer for 30 minutes. Not that bad on a large enough team with everyone taking turns. I should add that we have 3-4 "canned" questions that the HR rep writes down the answer to, so even in the "resume screen" there are a few super-lightweight technical questions.
Re:Tech Interview Handbook by mjfisher on Sunday August 18, 2019 @05:08PM (#20732872)
Interesting. I've got a feeling early stages of tech hiring pipelines are very poorly optimized at the minute; it's something I'm working on. Individual experiences help; thank you.
Re:Tech Interview Handbook by dccoolgai on Sunday August 18, 2019 @05:02PM (#20732835)
Another idea I've heard about but never got motivated enough to set up is a system wherein the applicant submits their resume via an api with some kind of trivial challenge... like "here is an id and an integer, multiply it by 2 and submit it with the id and your resume as a json with these fields or whatever." Might try it some day, but that's another idea to get some of the technical probe out early.
Re:Tech Interview Handbook by alibarber on Sunday August 18, 2019 @07:01PM (#20733507)
There's a company, I think it's Mythic Beasts in the UK, that has or had a job application that had something along the lines of (before you got to the form) 'first prove you're not a robot do this simple maths blah...' but every time you submitted your answer, by typing in and clicking on the page, you got an error page saying 'too slow'. I wasn't looking for a job at the time but that has to easily be my favourite application process ever!
Re:Tech Interview Handbook by dmoy on Saturday August 17, 2019 @11:07PM (#20727987)
> Is this kind of code problem too complicated in your opinion? For all I join in when complaining about irrelevant algorithmic

No. Just programming is actually not easy and a lot of people apply for jobs they can't do.

Plus, a nonzero number of people freeze up in any interview situation.

I once failed an interview loop because I forgot how bucket sort works.

Re:Tech Interview Handbook by agentultra on Sunday August 18, 2019 @12:30AM (#20728245)
Also 95% of job descriptions list skills candidates will never use and screen candidates with problems they will never encounter.

At the final interview to join the SRE team at Google I was asked to implement the kNN algorithm. I barfed at implementing a kD-tree after regurgitating the brute force solution.

Has any SRE ever had to implement a kD-tree in < 20 minutes or Google would go down?

I asked the interviewer at the end. They had never implemented one on the job.

As long as companies insist on these inane rituals I think it’s fair game to optimize for it as an interviewee.

It’s stupid but what else can you do?

Re:Tech Interview Handbook by CoolGuySteve on Sunday August 18, 2019 @02:37AM (#20728632)
The thing that really bugs me is that while Google has a reputation for asking these optimization questions, when it comes to programming artifacts one can inspect client side:

- Gmail loads slower than Eudora did on dial-up

- Chrome takes so much memory it’s basically a meme now

- The Google homepage (a text bar on a white background) is several hundred KB.

So what I want to know is, if they hire so many algorithmic whiz kids, where the fuck are they hiding?

Re:Tech Interview Handbook by masonic on Sunday August 18, 2019 @03:38AM (#20728795)
The (free) Google desktop suite has so many visible fails, it constantly surprises me. Gmail search gives a superset of results. Contacts editing is so slow, it must be doing something artificial behind the scenes. Contacts and Calendar entries rescroll back to the beginning whenever you change context. Even Gmail Labels are sorted differently between desktop and mobile, and navigating within a Label contents can lead you to a dead end that makes you reload Gmail.com from scratch.
Re:Tech Interview Handbook by username90 on Sunday August 18, 2019 @03:36AM (#20728789)
Very few at Google work at client side stuff, most sought after positions are many layers down the stack like machine learning, distributed infrastructure, programming languages or operative systems.
Re:Tech Interview Handbook by joshuamorton on Sunday August 18, 2019 @04:41AM (#20729024)
Right when you phrase things like that it does sound silly, but that's not what the google homepage is, nor is a literal webapp comparable to a desktop app in terms of load time (?!?).

Chromium at least is open source. Make it use less memory.

Re:Tech Interview Handbook by badpun on Sunday August 18, 2019 @08:24AM (#20729770)
IMO, Google and similar require you to spend a lot of time preparing and training stuff you won't need to select for:

a. hard workers, who will just do what is required without fussing

b. people who really want to work there, either because of the fantastic comp or because they drank the cool aid or they genuinely want to work on specific stuff that nobody else except the tech giants does.

I agree that it basically hazing, and has similar purposes - it discourages from applying people who are not hard workers or just don't care about working at a FAANG that much. As long as they still get tons of candidates, it's a great initial filter.

Re:Tech Interview Handbook by raincom on Sunday August 18, 2019 @01:27AM (#20728417)
They could be looking for those who participate in competitive programming contests.
Re:Tech Interview Handbook by greenyouse on Sunday August 18, 2019 @04:40AM (#20729019)
I've been through a few different types of interviews and the random algorithm style seems off to me. I recognize that there are companies like FAANGs that want a deep bench and will have expert algorithm people on-call for that one time when it's needed. Most companies should be OK to just present real problems either solved or being worked on which they would expect applicants to be able to solve.

This is more true for startups that need less know "how to reverse a binary string" and more "how to properly design a database with 3rd order normalization", etc. If you're presenting an interview question, it should have actual job relevance and your co-workers should be able to solve it in the same time as the candidate. If you're drilling people on non-job qualities (e.g. invert a binary tree for a web dev role...) then you should expect a large difference between audience that can pass your bad interview tests and audience which will perform well at actual job.

Not trying to complain. I think job interviews should focus more on the 99% of what you do in your job on a Tuesday. Poor interviews seem to be more gotchas and algorithm tricks to disqualify roles which have little actual use for algos + data structures. The tests might seem too easy but as a front-end engineer I would rather be with a coworker which understands the CSS box model, knows semantic markup for accessibility, and similar web things than a person which is good at creating hash tables and doubly-linked lists in JS. Leet code probably doesn't test vertical centering techniques with CSS but if you're applying for a web dev position you better know them.

Re:Tech Interview Handbook by nimrody on Sunday August 18, 2019 @01:49AM (#20728480)
One company sent me (before the interview) a small technical assignment. After I had submitted the code, an interview was scheduled. The entire interview was an extended code review -- talking about trade-offs, about other potential solutions, etc.

I felt this was much better in that it was less stressful, yet allowed me to demonstrate both knowledge and design skills.

Another company did something similar but more thorough: They invite candidates for a full day of work where they try to solve a small problem. Then the code is reviewed and evaluated together. They also start the day with a 1-hour overview of their current architecture and you get to ask questions and talk about alternatives. I think this gives both sides a better chance of finding the right fit.

I realize this is not always reasonable.

Re:Tech Interview Handbook by rhizome on Sunday August 18, 2019 @05:40PM (#20733098)
I've been thinking for a while that companies should create their hiring tests from bugs and/or feature requests that came from their actual software in the past. Then they can gauge the quality of the employee for their purposes by comparing the candidate's solution(s) to those the actual employees wrote.
Re:Tech Interview Handbook by nimrody on Monday August 19, 2019 @06:21AM (#20736480)
Bugs I have seen in actual code are divided into two types: those that are due to the way code inter-operates with other code (sort of integration bugs) and tricky bugs (usually edge cases) in some highly dense code.

The first type requires the candidate to learn a lot about the existing code base. The second requires more mental work but is atypical of real work.

Implementing features sounds like a good idea. Perhaps create a small well defined system which is a simplification of the real world system and let the candidate implement some additional features.

Re:Tech Interview Handbook by seanmcdirmid on Saturday August 17, 2019 @11:16PM (#20728015)
Resumes and prior experience should be taken more seriously, backed by more rigorous verification of said things and real reference checking. In a way, that is what already happens for the more technical positions (someone already knows you can do the job, the interview is just a formality) and sucks for those who don’t have well known enough reputations.
Re:Tech Interview Handbook by underwater on Sunday August 18, 2019 @04:24AM (#20728963)
> And as for the code, we included what we thought was a trivial nested for-loop problem and virtually nobody could even get started on it.

It's possible that you asked the question poorly, or the solution wasn't as obvious as you thought.

Designing interview questions is hard[1]. I'll test out new questions on my peers at least two or three times before putting them in front of a candidate. And many don't make the cut. If a good engineer who's relaxed can't solve it easily, then a stressed out candidate will have no hope.

[1] This is why I hate seeing candidates share specific questions online. As an interviewer you'll have to scrub a good question, and switch to something you're not as familiar with. This hurts good candidates.

Re:Tech Interview Handbook by toupeira on Sunday August 18, 2019 @08:51AM (#20729878)
At my current position for a remote job, one of the interview assignments was reviewing a pull request for a very basic example app using their tech stack, and then implementing my own suggestions during a video call (while sharing my screen), updating/running tests, discussing trade-offs etc.

I think this was a great way to not only verify coding ability, but also testing team work and communication skills.

Re:Tech Interview Handbook by _hardwaregeek on Saturday August 17, 2019 @11:12PM (#20728003)
Where are you posting your jobs? Are you paying a recruiter? How much? Maybe you could have interviewers rank candidates (hire; competent, but no hire; slightly incompetent; how did they get here?), then see where the majority of your "how did they get here?" candidates come from.
Re:Tech Interview Handbook by gaoshan on Sunday August 18, 2019 @02:10AM (#20728555)
For the code portion of things I stick to a set of increasingly difficult "real world" problems. The first one should be easily answerable by any potential candidate, the last one should be too hard for most people but I'm really looking at how they problem solve and handle themselves. I've recommended people for hiring who eventually gave up on that last one (and who went on to be fantastic in their jobs).
Re:Tech Interview Handbook by RijilV on Sunday August 18, 2019 @02:05AM (#20728538)
> Everyone has the same canned answers to the stupid behavioral questions.

The art of behavioral questions isn’t “ask and answer” it’s the follow up questions. As you astutely point out, the questions are ‘stupid’. They might as well be “do you want a stick of gum?”

Next time you ask those questions do a couple of things. First keep in the forefront of your thoughts what information you’re trying to get out of it and keep the candidate on track answering your data point. Do that by relentlessly asking follow up questions. When you think you have everything ask more.

As an anecdote I was being shadowed during an on-site recently. I asked some arbitrary ‘dumb’ behavioral question, went back and forth a bit, wasn’t getting much out of it. I noticed my shadow clearly moving on to the next question in their notes and decided to keep pushing on the original question - why did you do this, what were you trying to solve, what motivated you. Turns out the candidate did all of this to generate new revenue for the company and ended up bringing in $10m a year extra at the small company there currently worked for. Loads of great data, would have never gotten there if I’d settled for the canned answer the candidate had.

Behavioral questions aren’t comp-sci trivial questions, you can’t just ask the behavioral equivalent to fizbuz/Fibonacci/floodfill and copy down the answer (and you should never be asking those questions either, but that’s a separate rant).

Behavioral questions are stupid and to some degree that’s the point. When you ask your significant other or kids “how was your day?” — guess what, that’s a stupid question too. What matters is what follows from your line of interviewing.

If you want to get good at behavioral questions listen to Fresh Air and try to be like Terry Gross.

Re:Tech Interview Handbook by leovander on Saturday August 17, 2019 @10:53PM (#20727936)
Nest for loop for the technical interview? Where do I apply?
Re:Tech Interview Handbook by dustfinger on Sunday August 18, 2019 @06:15AM (#20729347)
> And as for the code, we included what we thought was a trivial nested for-loop problem and virtually nobody could even get started on it.

> Is this kind of code problem too complicated in your opinion?

May you please post the problem so that we can provide you with meaningful feedback regarding said problem?

Re:Tech Interview Handbook by watwut on Sunday August 18, 2019 @03:28AM (#20728771)
I like the for loop code thing. Imo, good hiring process for hiring programmers must involve small piece of code. Not difficult or algorithmic, but something to distinguish those who can't do anything at all.
Re:Tech Interview Handbook by Jach on Sunday August 18, 2019 @12:30PM (#20731190)
Seems like your problem is basic competency? Move the "can you even code?" question to as early in the filter stage as possible (first 'phone' screening). If you have a lot of applicants, you'll have to do some earlier filtering in the name of time (like on degrees, years experience, "the lucky half"), but don't pretend it's fair or very accurate since both the false positive and false negative rates will be high.

I agree that some coding problem needs to be used to try and answer the question, though with the right interviewer they can answer it without seeing code. The problems you use for that don't have to be at octree-collision-detection whatever challenge, a trivial nested for-loop is fine -- fizzbuzz level is fine. Sometimes you can rely on github or strong internal referral to skip this, but watch out, and anyway it's worth giving your questions to people you're sure will do fine (you've timed at least yourself right?) for the benchmark data and because sometimes they don't do fine, perhaps since maybe your question is too much. e.g. Floyd-Warshall can be done simply with a few nested loops, still I would never give it as a problem and I'd expect nearly everyone I've worked with to flunk it given only the standard hour (which really means 45 minutes).

Some jobs only need basic competence, so you might want to extend an offer if you've been convinced of its presence. At my last job, which ended up being more technically challenging / interesting than my current job, I was hired after posting my resume to Craigslist which led to exchanging some emails and having lunch with the startup founder to talk about my past work and whether I would be useful for his most pressing work. At my current job, I've been part of on-sites where I've established "can you even code?" is "no". Those were costly failures of not having that answered earlier. But we also like to believe we need more than basic competence, so rejections can still occur because of a lack of "testing mindset" or certain "behavioral answers". Only once you fix your "can you even code?" filter is it even worth considering what else you might want to justify an interview pipeline with more stages than a 'phone' screen or lunch conversation.

Re:Tech Interview Handbook by mjfisher on Sunday August 18, 2019 @01:47PM (#20731661)
I couldn't agree more with the idea that you should move a 'can you code at all' test to as early as possible in your hiring pipeline.

I used to wait to the first in-person interview to try simple fizzbuzz style questions (with the candidates on a machine and a compiler/interpreter). In about a third of cases that meant we'd committed a significant chunk of time to engineers that apparently couldn't solve trivial problems.

Now it's one of the first things I check. Done right, it's a relatively small hurdle for capable people to overcome, but really helps as a filter for those who aren't suited to the role.

I recently created a service (https://candidatecode.com) to help companies manage issuing and reviewing their coding challenges; I think it's got real potential to help some people out.

Re:Tech Interview Handbook by wan23 on Sunday August 18, 2019 @11:27AM (#20730747)
The way most fields that require some level of knowledge or ability handle this is by having industry-standard assessments that everyone takes. When doctors interview they get almost entirely behavioral questions because the hiring hospital / office merely needs to check that the doctor is a) licensed and b) certified in whatever specialty they are being hired for. They certainly never get asked whatever the medical equivalent of FizzBuzz might be.
Re:Tech Interview Handbook by wcunning on Sunday August 18, 2019 @02:24PM (#20731908)
I'm getting up the gumption to look for a different, hopefully better job in the nearer future (in automotive control software, looking to move to AV), and I had a bit of a revelation when talking to a friend of mine who does interviewing. I cannot talk about the things in my current job that would make me a good hire for the things I want to move into. It's all hunting down an obscure bug buried in layers of technical debt and overly complicated standards, but giving any depth beyond that bare platitude requires going into things that my NDA covers. I even work in driver assist technologies, but I can't go into detail about that because I'm working on unreleased, unannounced features. That means that the only thing left is side projects or whiteboard interviews. To be fair, this is at least partly an industry problem due to long product development cycles and a culture of secrecy, but it makes a lot of the better solutions to interviewing unworkable and causes companies to drop back to whiteboard interviews. And as a candidate, my personal maximizing function is to hit the books and be ready for curly braces and logic puzzles. Sometimes there really isn't a better way.
Re:Tech Interview Handbook by mixmastamyk on Sunday August 18, 2019 @09:40PM (#20734234)
“I’m under NDA” is a valid response. Have some hobby project or floss bug fix on github if there is time to fill.
Re:Tech Interview Handbook by alkonaut on Sunday August 18, 2019 @07:03AM (#20729516)
If you risk having a bullshitter you need some way of identifying them. The best way is through references, personal projects etc.

But if you need to recruit someone without any such credentials then you may need to do a simple coding aptitude test. Could be a code review or a simple excercise but whatever you do, don’t do whiteboard coding and don’t have people recite/implement memorized CS textbook algorithms. Anyone can do that and still no code.

Re:Tech Interview Handbook by dustfinger on Sunday August 18, 2019 @07:10AM (#20729533)
> Everyone has the same canned answers to the stupid behavioral questions.

If the person conducting the interview thinks the behavioral questions are stupid, then perhaps they are. In that case, don't ask "stupid" behavioral questions.

> Resumes are meaningless, and often re-written by recruiters to match the job anyway

Was the position entry level? Students coming right out of compsci often have little to no practicable experience. They may have difficulty thinking about what to put in their resume. After one or two years of full time experience that should no longer be an issue.

> For all I join in when complaining about irrelevant algorithmic questions, I have to admit that they at least test something, even if it's just willingness to study for the interview.

Asking those "stupid" behavioural questions and receiving the same canned answers also demonstrates a willingness to study for an interview.

The coding problem should be testing a candidate's problem solving capabilities as practicably required by the role being interviewed for. The chosen problem should reflect the types of problems that they will actually need to solve if hired. For example, you could select a small PR from one of projects being actively developed by the company. The selected PR should involve only one or two classes (assuming a language with classes) and require improvement. You can look through the history of a PR and just pull out a segment that was selected for improvement by the reviewer(s), or have the team select it for you. Then ask the candidate:

- to conduct a code review of the PR

- to improve the code

Re:Tech Interview Handbook by momokoko on Saturday August 17, 2019 @10:55PM (#20727941)
Is there any chance you could share the problem? Changed enough to protect your identity, of course.
Re:Tech Interview Handbook by DavidWoof on Sunday August 18, 2019 @01:19AM (#20728395)
It was very similar to the “given an array of stock prices, find the optimal buy and sell indices for the biggest profit" problem that somebody referenced above.

But we emphasized repeatedly we weren't looking for the O(n) solution, just the brute force naive solution was 100% OK. And it definitely didn't look like people were freezing up trying to figure out the optimal problem, they were struggling on the basic nested loop.

Re:Tech Interview Handbook by davidjnelson on Sunday August 18, 2019 @03:22PM (#20732250)
What works for me is to consider what work the engineer will be doing, and ask them to write code to prove they can do it.

For instance, a front end engineer can be expected to be able to write a to do list or similar app in a framework (ideally the one your team uses, but not a hard no hire if not) app with minimal googling (although that’s fine as long as not excessive) in ~45 minutes.

Then you have to look at what level of experience they have. Less experience requires more mentoring generally, which may be fine depending on how much time your team budgets for that work.

Lastly, measure their body language and tone of voice to check for red flags pointing to difficult communication styles or people who treat others poorly.

If all three match, hire!

Re:Tech Interview Handbook by ale22 on Saturday August 17, 2019 @10:53PM (#20727935)
How much were you paying for these positions?
Re:Tech Interview Handbook by DavidWoof on Saturday August 17, 2019 @11:02PM (#20727965)
Slightly above market rate for the area, all in the low-to-mid six figures.
Re:Tech Interview Handbook by numakerg on Saturday August 17, 2019 @11:15PM (#20728014)
Was this a position where they were expected to write code? I'm surprised that developers making six figures couldn't solve a problem that an interviewer considered trivial.

Any chance of a sample or maybe an alternate version of the problem?

Re:Tech Interview Handbook by maehwasu on Sunday August 18, 2019 @01:16AM (#20728381)
I have had similar experiences as an interviewer. It’s one of those things that you really have to see to believe, but it’s definitely a real thing.
Re:Tech Interview Handbook by ale22 on Saturday August 17, 2019 @11:06PM (#20727979)
Like $110k-$150k?
Re:Tech Interview Handbook by neetfreek on Sunday August 18, 2019 @01:35AM (#20728440)
I prefer take-home assignments. I know that they often get a bad rep and have the potential for abuse; for this reason I'd argue for implementing some or other solution in the field.

I recently had one requiring me to develop a native mobile application, which I enjoyed. It was interesting, the code is useful down the line, and if I don't land the job, it beefs up my portfolio.

Initial screening by recruiters is tough as my background's missing a degree and industry experience.

Context: self-taught, started out with game dev, tried going solo - not a runaway success. Looking to move away from the field.

Re:Tech Interview Handbook by danmaz74 on Sunday August 18, 2019 @03:55AM (#20728865)
I use basically the same process, but use a very simple programming problem at the end - simple, but amenable to discussing optimization and edge cases. I let the candidate choose the language (or just use pseudo code) and don't care at all about the syntax.

I find that this is very useful especially when interviewing juniors who don't have many projects under their belt for the first part. It's also useful when a candidate has good verbalisation skills, but poor programming ones (which happens).

Re:Tech Interview Handbook by bufferoverflow on Sunday August 18, 2019 @08:52AM (#20729883)
I have a similar experience doing interviews in NYC. We started by asking algo questions, but quickly found out that 95% of the candidates can't answer them. My boss, an ex-programmer, was surprised too, and she asked me to dumb them down, a lot. We ended up with a bunch of really trivial stuff like "write a function to reverse a string" or its slightly harder version - "reverse an integer".

Could you give the exact wording of your "nested for-loop" question?

Re:Tech Interview Handbook by daphneokeefe on Sunday August 18, 2019 @01:59PM (#20731746)
> we included what we thought was a trivial nested for-loop problem and virtually nobody could even get started on it.

If no one can answer the question, maybe they don't understand it? Maybe there's something unclear in the way it is worded?

Re:Tech Interview Handbook by ummonk on Sunday August 18, 2019 @12:55PM (#20731345)
I don’t think the problem lies with your interview if they can’t write a simple nested for loop...

Which I think is why a lot of startups locate in the expensive Bay Area - not a lot of cities have a similar concentration of decent talent.

Re:Tech Interview Handbook by winrid on Sunday August 18, 2019 @02:41AM (#20728640)
Phone screens should prevent those candidates from ever getting onsite.

You'd be surprised (or maybe not now) how many applicants for a senior frontend position can't build a progress bar for the phone screem.

Re:Tech Interview Handbook by shagie on Sunday August 18, 2019 @10:36AM (#20730354)
I've given phone screens to individuals who turned out to be a different person when they showed up onsite. Not "nice on phone, jerk in real life" but rather "Bob does the phone screen for Charlie (and passes), Charlie shows up at the onsite."
Re:Tech Interview Handbook by farah7 on Sunday August 18, 2019 @05:12PM (#20732913)
I usually have video off during phone screens. Do you require them on?
Re:Tech Interview Handbook by Aperocky on Sunday August 18, 2019 @07:36PM (#20733649)
This.

I loath writing algorithm on whiteboard, especially the 'catchy' type. But I've interviewed people who can't even write a for loop.. the amount of brain drain in the flyover country is insane.

Re:Tech Interview Handbook by traverseda on Sunday August 18, 2019 @02:05PM (#20731789)
> And as for the code, we included what we thought was a trivial nested for-loop problem and virtually nobody could even get started on it.

Could it be that you're having issues communicating the problem?

Re:Tech Interview Handbook by detaro on Sunday August 18, 2019 @07:32AM (#20729600)
> And as for the code, we included what we thought was a trivial nested for-loop problem and virtually nobody could even get started on it.

How did you run these? While it sounds like something that should be ok even on paper, you can vary comfort a lot through the medium. E.g. for the last interview I had with a substantial coding part, I think being able to do it on my personal machine made a big difference. (I obviously was told before what kind of environment I'd need to have ready)

Re:Tech Interview Handbook by choppaface on Sunday August 18, 2019 @01:12AM (#20728369)
I agree a code test is necessary. I’ve seen several panels neglect to do a code test, the candidate was hired, then within a month fired because it was clear they couldn’t do anything (other than, well, argue).

I’ve been in a panel where I was the only person who asked a code question, the candidate flunked, and then the VP of Engineering went over my complaints and hired the guy anyways. He had been a Professor of Software Engineering and had a graduate degree from Princeton. Within three weeks, the VP of Engineering had to fire him because he couldn’t make it through a simple code review.

BUT the extremely negative sentiment here towards the technical interview process is very well-deserved.

Assessment of code (and the selection of problems) is most often no less subjective than any non-technical assessment. Sometimes the interviewer doing the grading is flat out wrong. Several times I’ve been asked the famous “given an array of stock prices, find the optimal buy and sell indices for the biggest profit.” One interviewer was not aware of the linear time solution to this problem, and didn’t believe me when I wrote and tried to explain it to him.

But sometimes, the interviewer doesn’t even want you to do well. Once time I was interviewing with an injury that prevented me from typing efficiently. I had a doctor’s note and the injury was quite conspicuous. Nevertheless, three start-ups made me solve problems by typing on a keyboard, which guaranteed an excessively long completion time. Those companies held those results against me. (An it’s not like there is anybody to hold those panels accountable).

And then there are those who just don’t care. I had a phone interview with Airbnb that was literally as bad as the stories on Glassdoor: the guy answered the phone in a noisy office (not a conference room), gave no introduction, then simply stated the problem and dumped me into Coderpad. I literally thought it was a prank, since I had met with people at Airbnb face-to-face prior to the call. But the recruiters confirmed the guy was a real employee.

The root problem here is there is no feedback loop back to interviewers. The candidates get “feedback,” but people asking code questions, especially new grads, typically get zero assessment on how well they are doing as interviewers. What’s worse is that recruiters and hiring managers both have incentives to deprive ICs of such feedback, since it would invariably make ICs more aware of opportunities outside the company.

Until the incentive structure of technical interviewing changes dramatically, we’re stuck with Leetcode and hope for the best. People like Gayle Laakmann are helpful (especially when Facebook gives candidates a live hour-long session with her for free), but these people are ultimately invested in their own income and not the task of fundamentally fixing this broken process.

Re:Tech Interview Handbook by modzu on Sunday August 18, 2019 @12:57PM (#20731353)
what is everyone smoking? youre still trying to optimize for a test and not a job.

dont give them a fizbuz. give them an example of a real problem your engineers need / are trying to solve. how do they respond? thoughts / intuitions / pseudo code. do they show knowledge of the problem space / domain?

ot if you just want a kid who can code and they pass the fizbuz but fail at the real job, what does your training/culture look like? who does that really reflect on?

it seems to me that interviewing is terribly cargo cult. the problem is real, the practises ostensibly supposed to be solutions are not.

/end rant

Re:Tech Interview Handbook by non-entity on Saturday August 17, 2019 @11:39PM (#20728097)
I realize everybody's going to jump in and rant about algorithms in interviews, but I wish you'd all add something constructive as well.

I was like this a couple years ago. I was a self taught, "college is a scam", "practical experience" type guy. I now, however do see immense value in the ability to be able to work through these algorithm questions,especially if you ever want to do something besides web / app development.

Re:Tech Interview Handbook by goatinaboat on Sunday August 18, 2019 @02:27AM (#20728599)
Algorithms are great but in the real world what matters is being able to recognise a class of problem then go to the literature e.g. Knuth to find the right one. No working programmers know every algorithm off the top of their heads.

The classic detect a loop in a linked list question. The original guy took years to devise the algorithm for it. In an interview either you’ve seen it before, in which case you rattle it off, or you have to write a research paper effectively in 5 minutes.

Re:Tech Interview Handbook by alkonaut on Sunday August 18, 2019 @06:59AM (#20729503)
This. The problem a programmer needs to solve isn’t remembering or applying the algorithm, it’s identifying what needs to be done.

“This problem is (analogous to) loop detection”

“This problem requires a sorted list”

“This problem can be solved by depth first traversal”

Actually sorting a list or doing a traversal is easy after that crucial step. You can look it up. You can’t look up the step that told you what algorithm or data structure to use though.

Re:Tech Interview Handbook by scarejunba on Sunday August 18, 2019 @01:16PM (#20731486)
Yeah but there's a difference. We're immersed in a state of better knowledge. It took centuries for us to go from the forms of knowledge that are "truth is self-evident" to "verification:of consequents is the pre-eminent method of knowledge acquisition" to "failure to reject falsifiable ideas is the best method to acquire knowledge". But I took that same path without reading the philosophers in approximately ten years. How? Because the cultural milieu is different. I am a unit of a more capable civilization and I am therefore enhanced.

So am I smarter than Karl Popper? Not really. It's just easier to learn something than to find it. So, yes, I know the linked list answer.

Re:Tech Interview Handbook by patientplatypus on Sunday August 18, 2019 @10:04AM (#20730187)
This is surprisingly easy, but you have to understand what the problem is first or the solution won't be apparent. If this sounds patronizing it comes about from my frustration on being on the other side of the table too often.

What you want is very good football (soccer) players. Unfortunately you (or upper management) may not know all of the rules to soccer. You may not know the training regime that goes into winning a good soccer game - and it's a big risk spending money training for the big game on the off-season only to lose during the Big Show. So what do you do to test potential candidates? You see if you can get along with them, if they're a team player, and then see how well they play foosball.

It's perfect! There are soccer players on the field, there's a goal, it takes skill and coordination. But oh no, it turns out in the population at large really good soccer players really sort of suck at foosball. After all, they'd rather spend their time and energy playing soccer. So now they spend all their time reading up on books about foosball and what the best foosball strategies are.

You see where I'm going with this? No one uses algorithms in their day jobs. OK a few of you, but come on man, I make full stack web applications. As do most programmers. So why are you testing theory that has literally nothing to do with the job? Somehow someone thought this was a proxy for smart people, but I mean, if the guy who wrote this "Tech Interview Handbook" was really smart wouldn't he have spent his time writing a cool program? I mean how lame is this?

If you want to hire competent engineers tell them what you're building and ask them how they feel is best for them to show they're competent. If you have a big data pipeline in Scala ask if they can construct a data pipeline example that is cool over a few days (take home) or do something similar in the office. Some people like one, some like the other. But just communicate with the people you want to hire! And if not everyone's interview process is the same then maybe that's ok.

I mean I just got a guy who sent me some automated code interview program that had a timer that counted down from an hour at the top! WHO THINKS TREATING THEIR POTENTIAL EMPLOYEES LIKE STAR WARS DRONES IS A GOOD THING? All you have to do is treat the people you want to work with like you would want to be treated and demand that they know their shit.

This. Isn't. That. Hard.

Re:Tech Interview Handbook by rapht on Sunday August 18, 2019 @06:58AM (#20729495)
I don't work in tech (though I sometimes think about uuyýjmq
Re:Tech Interview Handbook by dehrmann on Saturday August 17, 2019 @11:51PM (#20728127)
> nested for-loop problem

Ah, dynamic programming.