News for hackers. Stuff that matters.
Re:Google admits brainteasers were useless for hiring (2013) by jeffreyrogers on Thursday May 31, 2018 @12:01PM (#17197339)
Here are two thoughts on tech interviews. One controversial and one (hopefully) not.

1. It's good that companies like Google are able to reassess their hiring policies and learn what works and what doesn't. It's easy to criticize companies for doing things that don't make sense or that we know to be bad, but often these things looked like good ideas at the outset and you need some amount of trying new things (many of which won't work out and may have negative consequences) in order to improve things.

2. The way hiring works in tech isn't really that bad. It doesn't really measure what matters for job performance but tech pays well and so many people want to do it that you need barriers to entry. The real losers of the hiring process are the companies that waste lots of money on inefficient hiring practices. If you compare the effort required to get a high paying tech job (really just doing practice problems for a few weeks/months) to any other high paying, professional field we have it much better.

Re:Google admits brainteasers were useless for hiring (2013) by sanderjd on Thursday May 31, 2018 @12:19PM (#17197528)
I mostly agree with both of your points, but I also think "we have it much better" depends on which "we" you're talking about. Our practices are better for people trying to break in and worse for seasoned professionals. It's more time consuming (and less well-paid) to become a nurse, but once you have done so, you don't have to do it again every time you switch jobs.
Re:Google admits brainteasers were useless for hiring (2013) by southern_cross on Thursday May 31, 2018 @02:32PM (#17198817)
My wife is a long-time hospital nurse, and she will be the first to tell you that hiring a nurse today is a much more tedious and time-consuming task than it was back in the day. Entry-level educational requirements are higher now, for one, and the whole hiring process at her hospital (which used to be relatively quick and straightforward) is now both tedious and time-consuming. Not surprisingly, this leads to an on-going shortage of nurses, with significant job-hopping from one hospital floor to another, from one facility to another, or from one organization to another. And surprisingly (or maybe not) the "new and improved" hiring process hasn't necessarily led to an improvement in the overall candidate pool, and in at least some cases has caused a noticeable decline.

As to "you don't have to do it again every time you switch jobs", nurses are often required to go through continuing education just to keep their licenses current. But making the jump from one type of nursing specialization to another, or even upgrading from an RN to a BSN (often required today if you want to keep your job - probably the exact same job that you've already been doing for ages) can be quite grueling - almost like starting over. In one recent case, a well-respected fellow nurse upgraded her education only to be to told that even that was no longer considered sufficient. She was already doing management-level work but didn't yet have the official title or the pay, and was told that she needed to go up an additional level in education in order to get that, so she just bailed - decades of experience walked out the door for no good reason.

Re:Google admits brainteasers were useless for hiring (2013) by sanderjd on Thursday May 31, 2018 @10:42PM (#17202196)
Continuing education is different, and in my opinion far more valuable, than preparing for tech interviews. I may still complain (because it's time consuming), but I would feel much much better about needing to learn some actual new stuff to move up a level. Instead, we go back and refresh old stuff which we don't remember very well because it hardly ever comes up.
Re:Google admits brainteasers were useless for hiring (2013) by commandlinefan on Thursday May 31, 2018 @04:38PM (#17200007)
> license current

I continue to be shocked that software developers aren't licensed at least like RNs or CPAs are.

Re:Google admits brainteasers were useless for hiring (2013) by dwoot on Friday June 01, 2018 @02:21AM (#17203009)
1. RNs have people's lives in their hands 2. CPAs have a fiduciary responsibility to their clients, especially in tax services

I think it is generally accepted that licenses don't signify "quality".

What are you hoping to gain with a license? Some badge that somebody can show to a prospective employer, so that they don't quiz you on capabilities?

I think we can agree that the field and knowledge required to perform as an RN doesn't change that often and the same goes for CPAs. However, the world of software is changing constantly. How could a licensing process ever stay up to date? Sure we could just test CS fundamentals and give people a stamp -- essentially what a degree is supposed to do. But if you're a software developer, like myself, that has interviewed many people and been subjected to many interviews, I know it's not a perfect process, but I've come across people that have exaggerated their abilities on resumés. One of the great things about software is GitHub, Bitbucket, etc. Why? Because it sometimes provides a window into the work of a developer before they make it on-site. I'd be happy if the industry as a whole just accepted this as the resumé and leaving the in-person interview as one that's non-technical, save for maybe something like FizzBuzz.

From my perspective, I think the idea of licensing is just an okay process for other fields. Without an interval of re-testing, how can we ensure that service providers can still deliver? I have friends that work at medical centers with doctors that have been there for decades that seem to have forgotten a thing or two, but refuse to accept the answer to a symptom or problem that is fresh in a new or recent grad's mind that's had fatal consequences. It's sad.

Re:Google admits brainteasers were useless for hiring (2013) by southern_cross on Friday June 01, 2018 @05:39AM (#17203860)
On the other hand, as a nurse my wife can relay stories going back to her earliest working days where more experienced medical personnel often had to step in to prevent a newly minted doctor from harming or potentially even killing a patient. I remember that giving oxygen was often the issue here, where the new doctors seemed to think that giving more oxygen was always better, but the nurses knew that giving too much oxygen can put a patient into crisis. (I forget why.) She hasn't mentioned this particular issue in ages now, though, so I guess these days medical schools are doing a better job here.
Re:Google admits brainteasers were useless for hiring (2013) by NTDF9 on Thursday May 31, 2018 @05:18PM (#17200376)
>> I continue to be shocked that software developers aren't licensed at least like RNs or CPAs are.

What a great idea! Let's call it a degree

Re:Google admits brainteasers were useless for hiring (2013) by Rychard on Thursday May 31, 2018 @06:58PM (#17201076)
According to the Stack Overflow's 2016 Developer Survey [1], "56% of developers in fact do not have a college degree in computer science or related fields"

Admittedly, the data is a few years old (and I didn't want to pull the same data from the 2018 survey), but such a requirement would put many people out of a job. I also haven't seen any concrete data that would support any correlation between the efficacy of a software engineer and whether they had obtained a college degree, so this seems like a poor metric.

I share your incredulity regarding the lack of any sort of "occupational license" for the industry, though I remain unconvinced that instituting one would have a positive effect.

[1] : https://stackoverflow.blog/2016/10/07/do-developers-need-col...

Re:Google admits brainteasers were useless for hiring (2013) by dwoot on Friday June 01, 2018 @02:02AM (#17202935)
In the 2018 SO Dev Survey, only about 25% of developers don't have any degree: https://insights.stackoverflow.com/survey/2018/#education
Re:Google admits brainteasers were useless for hiring (2013) by southern_cross on Thursday May 31, 2018 @09:23PM (#17201842)
Except that the degree itself may not be worth much in practical terms. For example, as a working student (paid computer nerd by day, student by night) I quickly came to the conclusion that much of what I was being taught in the CS program just wasn't going to be useful out in the real world. For example, at one point I was taught the detailed in and outs of two's complement arithmetic, but that's something that I've never used in practice, and I've only even seen it referenced maybe once every decade or so, if that. (See the following link for a very recent drive-by encounter with this stuff: http://www.open-std.org/jtc1/sc22/wg21/docs/papers/2018/p090...) Meanwhile, pretty much anything that's been of any real value to me on the job I've taught myself on a just-in-time basis.

As more recent examples, a few years back I took all three of the original free MOOCs from Stanford. In the ML class, Andrew Ng at one point said something like "If you've ever taken calculus then you will recognize this particular equation as being a derivative; otherwise don't worry about it because that's not really important." Later he said something similar about linear algebra and matrix multiplication. And indeed I had taken both calculus and linear algebra back in the day so I recognized what I was looking at, but it just wasn't important within the context of that advanced class.

I also took the Database MOOC, and during that the instructor taught quite a bit of formal database theory. (I forget the proper name for it.) But despite having worked with databases for decades now I've only seen such theory referenced maybe twice, and that just in passing, so it's hardly the "critical, need-to-know" stuff that the instructor insisted that it was.

Meanwhile, in the AI MOOC almost everything taught there was new to me, despite my having taken several AI classes back in the day; so basically zero overlap between then and now. (I did recognize some of the statistical stuff, though, from my statistics class way back when.) But will any of the new stuff ever be of any practical use to me? Probably not. Interesting certainly, but probably not at all practical.

Re:Google admits brainteasers were useless for hiring (2013) by true_religion on Thursday May 31, 2018 @11:59PM (#17202466)
You could do per-state licensing as happens in other professions.

So perhaps, California would have the highest standards with Google/Facebook employees pushing them to do so to create barriers to entry, but Mississippi would end up with the bare minimum.

I wouldn't find it terrible if Software Engineering were licensed, in the same way that law is---with the board consisting of prominent practicing members of the existing population, and all current members grandfathered in so it only affects upcoming generations.

Re:Google admits brainteasers were useless for hiring (2013) by southern_cross on Friday June 01, 2018 @06:08AM (#17203988)
You know, if they went down the licensing path then they would probably have to pretty much ban Windows for any serious professional use, since it's not really "fit for purpose" and never has been. (Minimal acceptable standards would probably be some type of hard-core Unix-like OS.) The same might be true for a lot of the open source stuff which is currently so popular.
Re:Google admits brainteasers were useless for hiring (2013) by kingbirdy on Thursday May 31, 2018 @12:41PM (#17197744)
I am very happy to take a month of brushing up on algorithms and so on every few years as I want a new job as opposed to an additional several years of school.
Re:Google admits brainteasers were useless for hiring (2013) by sanderjd on Thursday May 31, 2018 @01:39PM (#17198355)
I'm sure I felt like this when I was jazzed at how easy it felt to get my first good job with just a BS. After a few times through the job switch ringer at this point I'm rather bored of it and would much prefer to have a widely respected professional accreditation to point to instead of all the repeated pointless work. But I don't think the extra-school way (like in my nursing school example) is the only way to achieve that; what I would personally like to see is an apprenticeship / craftsman model. I think a PE requires both a master's degree and apprenticeship. Maybe we could do the latter without the former?

But this is idle wishing: the current system likely has to much inertia for real change at this point.

Re:Google admits brainteasers were useless for hiring (2013) by taude on Thursday May 31, 2018 @01:27PM (#17198253)
Do you have a family and other dependencies where taking a month off isn't really tenable after you leave your 20s, or whenever you settle down? It seems kind of absurd to take a month off every few years just to practice for a new job, whether the skills you're practicing are relevant or not to said job performance.
Re:Google admits brainteasers were useless for hiring (2013) by jaredklewis on Thursday May 31, 2018 @01:35PM (#17198321)
To me it doesn’t seem any more absurd than front loading 3 or more years of expensive professional school as do many other professions like lawyers, architects, and doctors.

Just pretend you went to law school and have to make monthly loan repayments each month. Put that money in bank account and you will have more than enough savings to take off work for a month every few years.

Median wage for programmers is nearly double the US median household income and has few barriers to entry. If the only downside is having to take a month off work every few years, I’m not complaining.

Re:Google admits brainteasers were useless for hiring (2013) by sanderjd on Thursday May 31, 2018 @01:47PM (#17198431)
The model I envy isn't lawyers, it's PEs. Their professional degree isn't exorbitantly priced and the education is very useful for the career rather than busy work (by the accounts of those I know). Once the credential is earned, it is widely respected.

Edit to add: In general, I don't think our system has to be worse than all others for it to be worthwhile to consider what might be better.

Re:Google admits brainteasers were useless for hiring (2013) by geebee on Thursday May 31, 2018 @02:05PM (#17198567)
The business model I envy is actuaries. The exams are rigorous, but leave it open how you wish to prepare for them. I considered this about 15 years ago when I was leaving grad school in engineering. To get through he first few exams, it's pretty clear that you need to understand vector calculus, linear algebra, and differential equations at the level you'd expect from the general undergraduate sequence for most STEM majors. I read that the most common undergrad major for the exams is math, but you're free to take the test if you've majored in something else, and I think you're welcome to self-study as much as you please. You just have to be able to pass the exams.

It's a rigorous exam, but to me, this is so preferable to a 5 hour interview on differential equations, stats, and linear algebra every time you interview. And that's pretty much what we do in software, it's the equivalent of asking a senior actuary to do an integration by parts or a complex derivative at the whiteboard during an interview.

What I also like about this approach is that we'd avoid that situation where a cartel like the law schools can put a 150k, 3 year degree in between talented people and the profession they'd like to enter.

Another thing is that tech exams are very capricious - you can end up with a totally unqualified interviewer, there's really no quality control on the questions or how the exams are administered. A more formal exam could have a lot of benefits, though I do agree that a required long degree program that is $$ would do more harm than good.

EDIT: There's is something that causes me to question some of what I wrote above - I have grown wary of many of the people who want to regulate software as a profession. I'm still stinging a from my collisions with the test-driven development crowd dating back over the last decade. They really were saying that to merely question the value of the methodology should render you un-hireable. Imagine if they got control over formal licensing. I do shudder at the thought. When I think of that possibility, the Wild West approach, unsavory as it may be, seems more appealing.

Re:Google admits brainteasers were useless for hiring (2013) by sanderjd on Thursday May 31, 2018 @11:18PM (#17202345)
I love this comment, both pre- and post-edit. It's definitely a tough problem, wariness is warranted, and there are worse models out there, but the problems are also real and worth discussing.
Re:Google admits brainteasers were useless for hiring (2013) by jaredklewis on Thursday May 31, 2018 @01:58PM (#17198509)
Sure, but doesn’t it require 4 years of school + 4 years working under a licensed PE, then state exams?

It is a very different set of trade offs than what we have in CS, where companies are more than willing to take a chance on bright people with non traditional backgrounds, including people that never went to college or dropped out. As a lifelong self-learner, I’ve certainly appreciated the lack of “credentialism” at tech companies.

The one part of the PE thing that I would like to see borrowed is the exams. If all companies are just running everyone through the same kinds of general CS problems anyway, might as well save everyone time and improve consistency by making a standardized test.

Re:Google admits brainteasers were useless for hiring (2013) by sanderjd on Thursday May 31, 2018 @11:20PM (#17202354)
I don't mind the standardized exams part, but the part I really like is the apprenticeship. Elsewhere in this thread I suggested that maybe we could pick that part up without going all in on the schooling side.
Re:Google admits brainteasers were useless for hiring (2013) by fjsolwmv on Thursday May 31, 2018 @07:50PM (#17201349)
It's not a month of 60hrs a week of studying. It's a month of doing practice problems after dinner and on weekends instead of watching netflix.
Re:Google admits brainteasers were useless for hiring (2013) by commandlinefan on Thursday May 31, 2018 @04:40PM (#17200029)
> taking a month off

A month off? I completed an MSCS (including a thesis) while working full time with two young children at home (my daughter was born in between my first and second year). I can't imagine educational/licensing requirements that would be more difficult than that; you can continue your education without dropping out entirely.

Re:Google admits brainteasers were useless for hiring (2013) by sizzle on Thursday May 31, 2018 @06:57PM (#17201056)
Any tips on how you organized your time to pull this achievement off? Congrats!
Re:Google admits brainteasers were useless for hiring (2013) by commandlinefan on Monday June 04, 2018 @11:29AM (#17228691)
A very supportive family - I don't think I could have done it if she had been complaining about it the whole time.
Re:Google admits brainteasers were useless for hiring (2013) by e40 on Thursday May 31, 2018 @01:05PM (#17198017)
In the example given, a nurse wouldn't need additional schooling to switch jobs.
Re:Google admits brainteasers were useless for hiring (2013) by szermer on Thursday May 31, 2018 @01:32PM (#17198298)
Everyone in the medical profession needs continuing education (CE) credits. Not much different from certs that support folks need to obtain if they work government/ DoD positions.

https://www.nurse.com/state-nurse-ce-requirements

Re:Google admits brainteasers were useless for hiring (2013) by vonmoltke on Thursday May 31, 2018 @01:36PM (#17198332)
CE classes for nearly all professions are a joke compared to the shit software engineers are expected to go through to rehearse for interviews.

As for government work, I'm not sure where you got that idea from. I did government work for 14 years and never needed any certifications. If I had, the company would have paid for it and it would have been on company time.

Re:Google admits brainteasers were useless for hiring (2013) by sanderjd on Thursday May 31, 2018 @01:50PM (#17198444)
Imagine CE credits for things like distributed systems and machine learning as you move along in your career: wouldn't that be more useful than brushing up on that Trie algorithm you'll never implement?
Re:Google admits brainteasers were useless for hiring (2013) by fjsolwmv on Thursday May 31, 2018 @07:49PM (#17201343)
Sure. So get that executive masters or Coursera certificate, and then spend an hour convincing an employer that you actually learned something in your course.
Re:Google admits brainteasers were useless for hiring (2013) by sanderjd on Thursday May 31, 2018 @11:14PM (#17202327)
It would be great if the continuing education most of us actually enjoy doing were a valuable thing to do. As it is, if you want to switch jobs, it's much more valuable to study old things that help with whiteboard interviews than to spend time learning new things.
Re:Google admits brainteasers were useless for hiring (2013) by e40 on Thursday May 31, 2018 @05:44PM (#17200578)
The issue is changing jobs, not keeping up with credits for your current job.
Re:Google admits brainteasers were useless for hiring (2013) by xamuel on Thursday May 31, 2018 @12:25PM (#17197596)
I come from academia and can confirm your #2. If you want to get a professor job, it's all about letters of recommendation, publication in prestigious journals, talks at prestigious conferences, etc. Programming interviews are extremely fair and meritocratic by comparison.
Re:Google admits brainteasers were useless for hiring (2013) by n1231231231234 on Thursday May 31, 2018 @01:18PM (#17198154)
How is academia unfair in that respect? "letters of recommendation, publication in prestigious journals, talks at prestigious conferences" are a reflection of your academic abilities in your field, no?

Sure, there is some noise; papers get rejected where they should not have been. And other papers that should have been rejected, do get in, etc. However, by the time you're applying for a professorship, you're abilities should clearly shine through that noise.

Re:Google admits brainteasers were useless for hiring (2013) by xamuel on Thursday May 31, 2018 @01:31PM (#17198288)
It's who-you-know, not what-you-know. I should mention, by convention, you do not get to see the letters of recommendation yourself, so you're at the writers' mercy. (At least in my field, mathematics; others might be different.) Papers and conference talks become harder to do if you're no longer affiliated. Your abilities will shine through if you're Albert Einstein, but the 99.99% of "rank and file" professors don't need to be Einstein.

I'm not intending this as an indictment against academia. They're faced with a hard problem: many more candidates than job openings. They couldn't possibly do whiteboard interviews like in software, just because of sheer logistics. I don't know how academia could do it differently. Software can do it better because there's a LOT more money in software.

Re:Google admits brainteasers were useless for hiring (2013) by meheleventyone on Thursday May 31, 2018 @01:38PM (#17198348)
Nepotistic practices are rife in tech as well. It’s quite possible to skip tech interview hazing by knowing the right people.
Re:Google admits brainteasers were useless for hiring (2013) by uluyol on Thursday May 31, 2018 @02:06PM (#17198577)
Who you know is very important for academics. The professors I know are always on the lookout for good collaborations and to discuss new problems. You can only be successful in academia if you have good ideas, can articulate them clearly, and know what other people care about.

Being smart and knowing your areas are only some of the requirements for being a professor. Having just those two is insufficient.

Re:Google admits brainteasers were useless for hiring (2013) by robotresearcher on Thursday May 31, 2018 @01:16PM (#17198138)
You imply that strong reference letters, strong publications and talks at top conferences are obtained unfairly. Why do you think so?

If you look at the batch of assistant professors that start every year at good schools, did they pick the wrong people?

Re:Google admits brainteasers were useless for hiring (2013) by foldr on Thursday May 31, 2018 @01:21PM (#17198182)
>You imply that strong reference letters, strong publications and talks at top conferences are obtained unfairly. Why do you think so?

There's no implication that the letters are obtained unfairly, but that doesn't necessarily mean that the resulting outcomes are fair. The point is that if you find yourself in a situation where you can't get hold of these things and yet you are, in fact, really good, there's nothing much you can do about it short of waiting a few more years and hoping to build up a better professional reputation. In contrast, you can just show up at a coding interview, demonstrate that you can in fact code (at whatever level is required), and land a job.

Case in point: I moved from academia to coding by doing this (without any relevant qualifications or having worked professionally as a software engineer). There is no equivalent progression for someone who wants to move to academia from coding.

Re:Google admits brainteasers were useless for hiring (2013) by robotresearcher on Thursday May 31, 2018 @01:40PM (#17198369)
The equivalent to acing a code interview for an academic is submitting a terrific paper. Papers are typically submitted to open calls without any referrals. If the paper has an impact, the rest of it follows.

Prestigious invited talks don't come out of the blue, but usually as a result of consistent work that people care about.

If a researcher can't get their papers published, in an activity where that is a key metric of success and the key communication medium, what's the basis of the 'really good' assessment?

Look at the list of keynote speakers at any major conference you understand. Are those the wrong speakers? Did they get this privilege unfairly?

Re:Google admits brainteasers were useless for hiring (2013) by kaitai on Thursday May 31, 2018 @02:08PM (#17198595)
I finally got one of the papers I'm proud of published! It was in review at a major journal for over a year, and then was soft-rejected for being too specialized (nice comments from referees though). Then it went to another journal, and was most of the way through the review process when the entire board quit to start an open-access journal. So we withdrew the paper and submitted to the open-access journal. They finally accepted with revisions last fall, and so I think it'll get published soon. Only three years from start to finish, where "start" refers to posting the finished paper to the arXiv!

Every job application process has its own kinds of luck and failure modes. The time scales of academia lead to very different distortions than those in software engineering.

Re:Google admits brainteasers were useless for hiring (2013) by robotresearcher on Thursday May 31, 2018 @02:15PM (#17198661)
Congratulations! A three-year ride is a outlier. I hope your arXiv version got some citations to keep you going emotionally and professionally in the meantime :)
Re:Google admits brainteasers were useless for hiring (2013) by foldr on Thursday May 31, 2018 @01:46PM (#17198420)
It's quite absurd to suggest either that (i) the review process is entirely fair or (ii) that it is possible to land an academic position merely by publishing papers. (If so, where are all the professors without PhDs these days?) I don't claim that the process by which hiring decisions are made in academia is notably unfair by the standards of life in general or in comparison to many other career paths. But when talking to another (ex) academic, you must know that you can't get away with those kinds of simplifications.

I don't understand your rhetorical questions. Clearly, yes, conferences choose bad speakers sometimes.

Re:Google admits brainteasers were useless for hiring (2013) by robotresearcher on Thursday May 31, 2018 @01:51PM (#17198456)
I didn't suggest either of those two points, which I agree are absurd.

I readily agree these selection processes are not perfect, and institutional nepotism in particular is an issue in academia.

Re:Google admits brainteasers were useless for hiring (2013) by foldr on Thursday May 31, 2018 @01:55PM (#17198483)
>The equivalent to acing a code interview for an academic is submitting a terrific paper.

You can get a coding job just by acing a coding interview (and having basic social/professional skills). So this part of your comment did appear to suggest that merely publishing papers can be sufficient to obtain an academic position.

Re:Google admits brainteasers were useless for hiring (2013) by robotresearcher on Thursday May 31, 2018 @01:59PM (#17198518)
You have to be invited to interview before you can ace it. So you probably have either a relevant degree or experience before you get in the room.
Re:Google admits brainteasers were useless for hiring (2013) by foldr on Thursday May 31, 2018 @02:12PM (#17198637)
It's very much possible to get a coding interview without either of these things.
Re:Google admits brainteasers were useless for hiring (2013) by HeyLaughingBoy on Thursday May 31, 2018 @04:56PM (#17200168)
I've hired many people and interviewed many more.

What possible reason would I have to interview someone if they had neither relevant experience, nor a degree? Should I just ask random people I see on the street to come in for an interview?

Re:Google admits brainteasers were useless for hiring (2013) by foldr on Friday June 01, 2018 @04:45AM (#17203629)
If they can write a good covering email, have a few github repos, and some other indications that they might be smart/capable. I know from experience that it is easy to get interviews on that basis.

If you're talking about people who have no experience in the sense that they've never written a line of code, then no, obviously not. But professional experience and relevant qualifications are not necessary.

As with any job application, you need to have something going for you. It just doesn't have to be any of those two things.

Re:Google admits brainteasers were useless for hiring (2013) by fjsolwmv on Thursday May 31, 2018 @07:53PM (#17201357)
No, you ask random people on LinkedIn like every recruiter does.
Re:Google admits brainteasers were useless for hiring (2013) by robotresearcher on Thursday May 31, 2018 @02:31PM (#17198808)
I used the word 'probably' on purpose.
Re:Google admits brainteasers were useless for hiring (2013) by foldr on Thursday May 31, 2018 @02:54PM (#17198998)
Ehh, I guess, but lacking relevant qualifications and experience doesn't even make it difficult to get a coding interview. It is no doubt the case that most people being interviewed have relevant qualifications and experience, but that's not because there's all that much of a barrier to people who don't. There is certainly far less of a barrier than there is in academia.
Re:Google admits brainteasers were useless for hiring (2013) by watwut on Thursday May 31, 2018 @02:38PM (#17198867)
"It doesn't really measure what matters for job performance but tech pays well and so many people want to do it that you need barriers to entry. The real losers of the hiring process are the companies that waste lots of money on inefficient hiring practices."

The other losers are people who have skills and aptitude that is actually needed, but don't have the thing that interview measures. Yet other losers are people forced who have to work with those who ace interviews and get rewarded, but are not actually good in actual work.

The side note is not just that hiring don't really measure what matters for job performance. It is also that companies themselves don't really seriously care about it nor spend time thinking about it. That affects not just hiring, but also promotions and other rewards. Which in turn causes additional problems and unhealthy workplaces (excessive crunch being one of those, huge amount of socialization that is expected in some companies another, ridiculous technological decisions too and so on and so forth).

Re:Google admits brainteasers were useless for hiring (2013) by taurath on Thursday May 31, 2018 @02:47PM (#17198939)
The focus on hiring is not about assessing job performance. This is absolutely clear to me after spending a bit of time as a contract worker with an exemplary record and a page full of recommendations from full time employees of many levels, who still has to pass through the same hiring gatekeeping process. Its now HR required that everyone be interviewed in the same manner. Performance means nothing in the interview - and the interview absolutely has nothing to do with the job, its just a bunch of alg questions. Its incredibly frustrating and disheartening to know how much they are skewing towards people who can pass the test rather than people that can excel at the job.
Re:Google admits brainteasers were useless for hiring (2013) by watwut on Thursday May 31, 2018 @03:33PM (#17199378)
I think that "everyone is interviewed in the same manner" thing can eventually evolve into better hiring process - because it will overtime produce data that can be learned from.

But, I also think that it will end up split into different kinds of interviews for different positions. The older I am the more I believe that there is no single "good in tech" aptitude and that such notion is nonsense. Rather, different tech jobs require very different amounts of abstract thinking, logic, patience, memory, aesthetic feel, detailed knowledge of some sub-area, ability to communicate, self control, punctuality and so on and so forth.

You can be quite crappy at assembler and heavily talented for enterprise java for example. You can be good at smaller projects and completely fundamentally fail in large codebase many people situation.

Re:Google admits brainteasers were useless for hiring (2013) by taurath on Thursday May 31, 2018 @08:52PM (#17201656)
> I think that "everyone is interviewed in the same manner" thing can eventually evolve into better hiring process - because it will overtime produce data that can be learned from.

I agree also in theory, but as you said there are vast differences in speciality. Some programmers are far more product focused and have an eye for design and communication, and some only do well when they're deep in the weeds of some obscure perf optimization. The latter gets hired quicker, while the former can often do a lot of useful things for an organization.

Re:Google admits brainteasers were useless for hiring (2013) by fitpolar on Saturday June 09, 2018 @07:10AM (#17272457)
This has been my experience too, and I’ve thought long and hard about how we’ve gotten to hiring practices that rewards 6 week boot campers more that seasoned pros who do outstanding work. I’ve come to the same conclusion, that it’s got to be because of bloated HR. It’s harder for me to pass interviews today vs 5 years ago, despite being less junior and more than capable of doing an A+ job.
Re:Google admits brainteasers were useless for hiring (2013) by majormajor on Thursday May 31, 2018 @12:22PM (#17197563)
> If you compare the effort required to get a high paying tech job (really just doing practice problems for a few weeks/months) to any other high paying, professional field we have it much better.

So here's the selfish-as-a-hiring-manager side of not liking the current style of interview questions: I don't want my bar to be so low that studying for a few weeks or months is all it takes.

One or two medium-level problems to make sure they're not full of shit about being able to write code at all, sure, but the rest is gonna be a lot more targeted to the role.

Re:Google admits brainteasers were useless for hiring (2013) by bluGill on Thursday May 31, 2018 @12:44PM (#17197785)
If you are a great programmer, then within two weeks of working with me you will be great at my company - in fact when asked how you are doing I will be shocked when I realize that you have only been here 2 weeks instead of 5 years.
Re:Google admits brainteasers were useless for hiring (2013) by unit91 on Thursday May 31, 2018 @01:04PM (#17198009)
This can only be true if your codebases are very small (e.g., at a rinse-and-repeat site mill).

For anything non-trivial, as your code grows the amount of time required to understand it will grow too -- even if you're using "standard" frameworks, etc. -- because the business logic driving your design decisions is learned with experience. For example, we have a guy at our large company who's a terrible programmer but we keep him on the team (albeit somewhat quarantined) because he's been there forever and has enough institutional knowledge to be valuable.

As your systems grow even more, there will not be off-the-shelf solutions. You'll have to sit down and do some real-life architecting and that won't be learned in 2 weeks. Even if you could perfectly document all your systems and design intentions (you can't), well documented decisions still take time to be read and "soak in".

Re:Google admits brainteasers were useless for hiring (2013) by whyaduck on Thursday May 31, 2018 @01:15PM (#17198131)
Exactly. Add interaction with highly complex custom hardware and you're looking at more like 2 years rather than 2 weeks to get to the point where anyone can claim expert level knowledge.
Re:Google admits brainteasers were useless for hiring (2013) by bluGill on Thursday May 31, 2018 @02:42PM (#17198903)
I've been on both sides of this with large code bases, and I disagree. A good programmer can get into even very messy code bases quickly. Even in the worst case of ugly code there is a structure/architecture trying to keep thing understandable.

Or maybe it is easier in large code bases because the worst programmers fail? I don't know, I haven't worked with many tiny code bases.

Re:Google admits brainteasers were useless for hiring (2013) by clintonb on Thursday May 31, 2018 @09:21PM (#17201832)
I've been at a new company for a few months, and still find the codebase confusing/frustrating. At my previous job, I was a tech lead/architect. Here I feel like a dummy. Talent can't necessarily overcome poor documentation.
Re:Google admits brainteasers were useless for hiring (2013) by majormajor on Thursday May 31, 2018 @12:49PM (#17197835)
So what are you saying here? You only hire great programmers? And they all shock you in the same way? Or you hire some mediocre ones too who don't shock you that way? And how do you interview them?
Re:Google admits brainteasers were useless for hiring (2013) by bluGill on Thursday May 31, 2018 @02:45PM (#17198930)
We hire a mix. The good ones (there are a lot of good ones) are quickly making useful progress. The bad ones sound good and seem to be asking the right questions, but never really make progress. My boss said he knew in a week if someone was good because that is the longer it took for the team to say "he knows what he is doing, we rarely check on him", while the bad ones "He is making progress but isn't ready to be left alone". Only after a couple months are the other programmers willing to admit the guy who seems like he knows how to code can't write code.
Re:Google admits brainteasers were useless for hiring (2013) by majormajor on Thursday May 31, 2018 @04:04PM (#17199708)
I generally agree with this - I've had pretty solid impressions of capability after a few weeks that have largely been proven out.

The challenge I'm still facing is crafting interview questions that most effectively match those two-week impressions.

My issue with purely sticking to coding questions is that I've seen a handful of people study enough to nail those and then be completely uncreative or unmotivated beyond that. Specificity seems to be a key thing in other types of questions, to at least weed out the hopeless. You built this thing? You had that experience? Tell me the details. Tell me the details of those details. Etc.

One of the things making it hard is that the true standouts are rare enough that I've only hired a couple of them, so it's hard to find what's meaningfully shared between them that's identifiable in a single day.

Re:Google admits brainteasers were useless for hiring (2013) by fitpolar on Saturday June 09, 2018 @07:01AM (#17272431)
I tend to disagree with this close minded judgement. Only because I’ve seen employees who I’ve written off after a few weeks become the goto brain after 6 months on the job. They exhibit a quality that can turn things around. Maybe you haven’t worked with enough really good programmers.
Re:Google admits brainteasers were useless for hiring (2013) by TooBrokeToBeg on Thursday May 31, 2018 @12:53PM (#17197883)
> So what are you saying here? You only hire great programmers?

I'm not sure how you could have confused what was posted, to be interpreted that way.

Re:Google admits brainteasers were useless for hiring (2013) by GavinMcG on Thursday May 31, 2018 @01:06PM (#17198021)
Given that he did it might be more helpful to offer a better interpretation, rather than just being dismissive.
Re:Google admits brainteasers were useless for hiring (2013) by TooBrokeToBeg on Monday June 04, 2018 @01:00PM (#17229806)
> Given that he did

You made up a question that wasn't posted. Please re-read the thread. Please don't attribute your words to someone else. It's transparently dishonest.

Re:Google admits brainteasers were useless for hiring (2013) by majormajor on Thursday May 31, 2018 @12:56PM (#17197910)
I asked because the relevance was not evident to me, in a discussion of hiring processes, unless it was directly related to his own hiring process in some way.
Re:Google admits brainteasers were useless for hiring (2013) by ddorian43 on Thursday May 31, 2018 @12:18PM (#17197517)
WTF type of interviews do lawyers, doctors, engineers have ?
Re:Google admits brainteasers were useless for hiring (2013) by jeffreyrogers on Thursday May 31, 2018 @12:23PM (#17197575)
It's not the interviews. It's what it takes to even get an interview. Doctors have 4 years of med school, then 3-7 years of residency, then probably a fellowship if you're in a competitive specialty. Lawyers get 3 years of law school and then probably only get a job at a good firm if they went to a top law school. Then they work terrible hours. Finance jobs are very hard to get unless you have the right background. Other engineers might have an easier interviewing process but they don't get paid as well (plus they need a real engineering degree).
Re:Google admits brainteasers were useless for hiring (2013) by deaddodo on Thursday May 31, 2018 @04:17PM (#17199818)
Petroleum Engineers (US median - 129,990USD) and Computer Engineers (111,730 USD) are some of the highest paid engineers there are. And quite a few are in the same realm as Software Engineers (100,690 USD):

  * Electrical Engineer - 95,230 USD
  * Chemical Engineer - 97,360 USD
  * Mechanical Engineer - 83,590 USD
  * Biomedical Engineer - 86,220 USD
And when you consider the skewing of those salaries due to the majority of software engineers working in LA (and surrounding SoCal areas), SF, Austin, Denver and New York vs petroleum engineers working throughout the interior US, the gap is much larger.

Software engineers are paid well, but there are definitely other engineering fields beating them.

Re:Google admits brainteasers were useless for hiring (2013) by fjsolwmv on Thursday May 31, 2018 @07:56PM (#17201371)
Software engineer has a huge range, from $80K/yr senior engineer at Epic in Ohio, to a college hire at FAANG getting $200 total comp in year 1, $300k/yr in year 5.
Re:Google admits brainteasers were useless for hiring (2013) by deaddodo on Thursday May 31, 2018 @09:01PM (#17201714)
Which is why I used the national median. And also pointed out the skewing. Since there are a ton of SWE in SF making 140-190k (and more with experience + title increases). But you're unlikely to make anywhere near that in Indianapolis, Cleveland, Mobile, etc.

Petroleum engineers, on the other hand, make 100+k in pretty much any region.

Re:Google admits brainteasers were useless for hiring (2013) by jeffreyrogers on Friday June 01, 2018 @02:45PM (#17208678)
Well being a petroleum engineer does limit you to regions that have oil and gas (or I guess you could work at a refinery too), but I see your point that there are some engineers who are compensated similarly to software engineers. I am not sure what their hiring process is like though.
Re:Google admits brainteasers were useless for hiring (2013) by k1ns on Thursday May 31, 2018 @12:47PM (#17197807)
I recently interviewed at a well-known software company, was turned down, and have very mixed feelings about the entire situation. I was tasked with a total of 7 coding problems, 5 of which took place in an onsite interview that lasted around 5 hours. The problems were fun, the interviewers were great, and I'd ultimately rate the experience as the best hiring process I've been a part of. I personally think that these problems were exactly the type that tech companies need to be using as they were focused on creativity and your thought process as opposed to some "genius detector" brain teaser. I passed each problem with flying colors, except for the final one.

The point of this final exercise was for me to talk through my thought process. It was a debugging problem, and I eventually succeeded, but not without fumbling around for 15 minutes or so. The solution was a stereotypical example of being "right in front of you", but the nature of this exercise threw me off. When I look back, the analogy that makes the most sense to me is the boxing glove wall from the TV show, Wipeout [1]. It's a simple problem of getting from point A to point B with the twist of getting punched in the face, or the stomach, or the leg, at seemingly arbitrary intervals. I can see this as a good simulation for the reality of an engineering job (being faced with unplanned interruptions and having to bounce back from them) but, at the same time, I've never had to verbally talk someone through every keystroke and mouse movement that I make while debugging. I was frustrated with the exercise and with my inability to immediately diagnose the issue. The interviewer was amazing at getting me back into the right mindset after noticing I had fallen off the wagon each time, which showed me just how good of a manager they were. However, the more I realized how terrible I was doing, the worse I performed. I left with the unmistakable feeling of dread having set-up camp in my stomach. Despite arriving at the solution, I knew I had blown that exercise.

In the end, I was turned down. The official reason was that another candidate had accepted an offer for the position, but the hiring manager also told me that my programming skills were perceived as sub-par due to the final exercise. They said I'd be a great fit culturally, and that their team enjoyed the conversations we had, but my Python skills just weren't good enough. Being someone that really identifies with their abilities as a programmer, with Python being my language of choice, this verdict has kept me awake at night. I'll never know if the actual reason was due to the other candidate accepting or due to me being my own worst enemy during the final exercise.

The tech hiring process is one of the only times I've gotten 100% of the problems correct yet still failed. Half of me says that's bad, but another part of me understands in situations that require context like mine above. It's not the manager's job to babysit me when I psych myself out, or when I'm having a bad day. Engineers need to be reliable and stable enough to work efficiently on their own. Had I been alone, I would have found the solution much quicker. But you're almost never alone in a real work environment. Some of these exercises are measuring much more than just algorithmic competency.

[1] https://www.youtube.com/watch?v=0XGmcQPCSG4

Re:Google admits brainteasers were useless for hiring (2013) by sjg007 on Thursday May 31, 2018 @02:01PM (#17198526)
I wouldn't worry about it. It is their loss. I would imagine that if Google did a randomized controlled trial among a pool of qualified resumes (say after they pass a phone screen) or a small coding challenge.. that they would find that job performance is not correlated with technical interview performance. They already found that GPA and where you went to school doesn't matter. In fact Bock thinks it's only behavioral traits that determine performance. So here's a challenge to Google or Facebook: ask the behavioral questions, ask some technical ones. Score only on the behavioral and hire. In one year see what the "performance" levels are... I'm guessing they did the latter test where they accepted based on technical performance and ignored the behavioral pieces which is why Bock nows says that behavioral are the most important...

My hypothesis is that the bar is still too high and that if you have a basic technical baseline you'd still perform well regardless of your white-boarding abilities. Google could run this experiment and in fact they might already have enough data to answer it with a causal analysis.

The key issue is how do you define "performance" both in the interview and in your yearly review... nobody has a clue how to actually measure performance.

http://www.businessinsider.com/how-google-hires-people-2013-...

Re:Google admits brainteasers were useless for hiring (2013) by fjsolwmv on Thursday May 31, 2018 @07:58PM (#17201379)
You are misreading the research, which showed that after filtering for interview performance, excess programming talent or GPA wasn't important.
Re:Google admits brainteasers were useless for hiring (2013) by mixmastamyk on Thursday May 31, 2018 @02:12PM (#17198630)
Yes, a time-consuming disaster, the tech interview has become. Same thing just happened to me yesterday. I'd be willing to challenge the interviewer to an impartial programming competition.
Re:Google admits brainteasers were useless for hiring (2013) by ksk on Thursday May 31, 2018 @12:17PM (#17197501)
> The real losers of the hiring process are the companies that waste lots of money on inefficient hiring practices.

In this case though, how is 'lots of money' wasted? It seems that Google hired good candidates despite some of the questions being bad. I think the point here is that Google is looking to increase the efficiency in interviewing, but they're already at a high efficiency level anyway so they continue to be successful in attracting and keeping talent.

Re:Google admits brainteasers were useless for hiring (2013) by bluGill on Thursday May 31, 2018 @12:49PM (#17197842)
Well sure, there are a lot of good candidates. Most bad candidates don't even apply.

What if instead of reading resumes/interviews/whatever else they did they just put all the names into a hat and made offers to everyone selected? This is your baseline, does your process beat this? If not, you could save a lot of time/effort using the hat selection method. (note that it is possible to be worse than the hat method)