News for hackers. Stuff that matters.
Re:The Engineer Crunch by GFK_of_xmaspast on Tuesday February 18, 2014 @09:26PM (#7261464)
They're asking you that because there are lots and lots of candidates who look great on paper but don't actually know anything. I have personally met several.

I wouldn't ask a candidate to implement a min-heap (mostly because it's kind of obscure and I'd have to think about it) but a depth (or breadth) first search is something I'd expect any competent candidate to rattle off in a heartbeat, just because it's such a fundamental cs principle that gets used in lots of places and, unlike things like sorts, doesn't really have a good library to fall back on in practice.

Re:The Engineer Crunch by theboss on Tuesday February 18, 2014 @09:44PM (#7261495)
Believe me, I can and do implement them, but I always do so backhandedly. ``I am a security engineer, what does this have to do with security''.

In reality, I have not accepted an offer from any companies who ask me these questions because most of the positions are not exactly what I am looking for.

Also, I tend to disagree. Some of the best security guys out there never went to college. It's hard to expect these guys to know algorithms and datastructures even if they are really gifted exploit developers, or the like.

edit: To clarify. What this really shows is that I am not being interviewed by a security person...ie there is no special interview process for my position compared to a regular software engineer.

Re:The Engineer Crunch by GeneralMayhem on Tuesday February 18, 2014 @10:23PM (#7261616)
I really doubt that it's possible to be a top exploit developer and yet be unable to implement BFS/DFS in under fifteen minutes. Some things really are just the absolute basics. If it never goes further, then that's a problem, but there are enough people out there who can't write ten lines of code that you have to weed them out.

My cousin's employer has started using Javascript Under Pressure [1] as the first round of technical interviews - it lightens the mood, and fully half of the people applying for a front-end development position at his company can't finish the first one, which is literally to write a function that returns the argument multiplied by two.

[1]http://games.usvsth3m.com/javascript-under-pressure/

Re:The Engineer Crunch by fineline on Wednesday February 19, 2014 @07:06AM (#7263175)
Relaxing with a few beers at home, this was fun. "12 minutes, 19 seconds for all 5 levels. Well done!" Don't care that I'll be blasted for being a slow old man. Come on, you know you want to! Stallman, babbage, lovelace and torvalds await.
Re:The Engineer Crunch by sireat on Wednesday February 19, 2014 @07:37AM (#7263289)
That was great fun for non webdev Javascript coder, and I was about 3 mins in and finishing 4th problem.

However, getting one of the tests wrong in 4th problem because of two chinese UTF-8 symbol having more length than "tiny" kind of irked me and reminded me why I do not do webdev.

I suppose this is actually a good kind of test, because real webdevs would actually have learned not to use s.length but use something else.

What is it though? This seems like a Javascript fail more than anything else.

Re:The Engineer Crunch by danielweber on Wednesday February 19, 2014 @08:50AM (#7263581)
I just did that and I'm pretty sure I used "s.length()" and I didn't even notice any Chinese characters.
Re:The Engineer Crunch by sireat on Thursday February 20, 2014 @04:57AM (#7269945)
I had to check typeof (apparently those two chinese characters are not a string) to fix this, again this is actually useful, but was not expected given the ease of first 3 problems.
Re:The Engineer Crunch by jtheory on Wednesday February 19, 2014 @01:24PM (#7265155)
Please put a warning if you link to a site that auto-plays audio.

Gah, that made me jump.

Re:The Engineer Crunch by drblast on Tuesday February 18, 2014 @11:44PM (#7261844)
Ok, that JavaScript under Pressure is a lot of fun and it would make a great ice-breaker.
Re:The Engineer Crunch by gaadd33 on Tuesday February 18, 2014 @09:57PM (#7261533)
I doubt "the best security guys" end up with the same interview experience. If you are widely known in the industry as an expert or the best at something I think the process to obtaining a job is significantly different from someone applying for jobs.
Re:The Engineer Crunch by tptacek on Tuesday February 18, 2014 @10:21PM (#7261609)
Not here. I am way more scared of the "best" candidates than I am of the normal ones.
Re:The Engineer Crunch by foobarian on Wednesday February 19, 2014 @12:23AM (#7261957)
I would imagine with someone like Bruce Schneier, you'd be paying them for the name and not their output. Google did it with a bunch of legendary computer scientists. Their role is mainly to get top notch junior people to come work there.
Re:The Engineer Crunch by gaadd33 on Wednesday February 19, 2014 @12:06AM (#7261901)
Really, that's surprising to me. Would people of Bruce Schneier/Fyodor/et al stature go through the same interview process that everyone else goes through? I'm pretty sure they wouldn't at a big company but you guys do things differently (for the better it seems) so maybe?
Re:The Engineer Crunch by tptacek on Wednesday February 19, 2014 @12:30AM (#7261979)
Yes, they would. I am 100% sure of it.
Re:The Engineer Crunch by pgeorgi on Wednesday February 19, 2014 @04:36AM (#7262752)
For all I know Fyodor is a collective of cheap developers and designers from far-far-away coordinated through an outsourcing agency with a single front figure reading from a teleprompter.

That would still be a notable effort, but I'd like to know who I'm hiring and for which qualifications (cat herding or design and implementation).

Re:The Engineer Crunch by gaadd33 on Thursday February 20, 2014 @10:56PM (#7275358)
Do you also feel that Bruce Schneier could be a collective of cheap developers? That seems like a pretty odd position to take give Fydor's identity is widely known. (http://insecure.org/fyodor/)
Re:The Engineer Crunch by VLM on Wednesday February 19, 2014 @11:06AM (#7264235)
"For all I know Fyodor is a collective of cheap developers and designers from far-far-away coordinated through an outsourcing agency with a single front figure reading from a teleprompter."

And would that matter?

Re:The Engineer Crunch by pgeorgi on Wednesday February 19, 2014 @12:05PM (#7264591)
In general? No.

When the teleprompter reading person applies for a security job they're supposed to do alone? yes.

Re:The Engineer Crunch by GFK_of_xmaspast on Wednesday February 19, 2014 @01:21AM (#7262139)
What kinds of questions would you expect to be asked for an interviewer to distinguish you from someone who looks good "on paper" but is a big phoney?
Re:The Engineer Crunch by draugadrotten on Wednesday February 19, 2014 @03:45AM (#7262570)
We apply a "peer" interview model, where candidates before being offered a job have to sit down with two of their future peers. This takes care of the phoneys as their (already successful) peers see through the posing.

Interview Process is: HR filter -> Manager interview -> Grandfather (Manager's Mgr) interview -> Peer meeting

The peer meeting isn't conducted in an interview setting. It's more informal, adapted to the needs of the applicant. It could be a lunch or a dinner and once it was even participating together at a hackathon.

We carefully select peers against "buddy bias" and encourage diversity in the workplace.

Our company is over a period of several years very successful in recruiting and have very little turnover. The biggest drawback could be that we are "too picky" and thus (at times) have problems growing fast enough.

Re:The Engineer Crunch by snowwrestler on Wednesday February 19, 2014 @08:42AM (#7263536)
Exactly. A false positive in the interviewing process (hiring a dud) is much more likely than a false negative (turning off a great candidate).

The secondary reason to ask these easy basic dev questions is an attitude check. Someone who gets personally offended at being asked to do something that is easy for them has a risk factor for being a poor teammate.

Re:The Engineer Crunch by vonmoltke on Wednesday February 19, 2014 @09:04AM (#7263637)
> A false positive in the interviewing process (hiring a dud) is much more likely than a false negative (turning off a great candidate).

I see statements like this thrown around a lot. Do you have precision/recall/F-measure numbers to back this up?

Re:The Engineer Crunch by snowwrestler on Wednesday February 19, 2014 @11:09AM (#7264257)
The most famous example I know of is the guy who implemented a FizzBuzz test and thereby eliminated the vast majority of programmers who otherwise appeared qualified on paper and in person. I don't have the link handy but I think it was covered in codinghorror.com.
Re:The Engineer Crunch by vonmoltke on Wednesday February 19, 2014 @12:20PM (#7264687)
I have been very interested in running a similar experiment myself, but alas I am not a hiring manager. As I recall from that example, there were no details of what counted as "qualified" on paper and in person.
Re:The Engineer Crunch by eru on Tuesday February 18, 2014 @11:56PM (#7261876)
> [...] unlike things like sorts, doesn't really have a good library to fall back on in practice.

Depends on your language. Some are better able to abstract and express this `pattern' as a library.