Re:ChatGPT Passes Google Coding Interview for Level 3 Engine...
by ianbutler on Saturday February 04, 2023 @02:20PM
(#34657227)
We've been saying for years these interviews are not predictive of job performance. Here's the proof.
Nothing you do in an interview like this resembles day to day work in this field.
Re:ChatGPT Passes Google Coding Interview for Level 3 Engine...
by SpeedilyDamage on Saturday February 04, 2023 @03:00PM
(#34657609)
For what it's worth, when I ask these kinds of questions (rarely anymore), I'm looking more at how the problem is solved, not what the solution is.
A wrong answer with good thinking is better than a correct answer with no explanation.
Re:ChatGPT Passes Google Coding Interview for Level 3 Engine...
by jokethrowaway on Saturday February 04, 2023 @03:11PM
(#34657729)
Chatgpt can provide you a great explanation of the how.
Oftentimes the explanation is correct, even if there's some mistake in the code (probably because the explanation is easier to generate than the correct code, an artifact of being a high tech parrot)
Re:ChatGPT Passes Google Coding Interview for Level 3 Engine...
by morelisp on Saturday February 04, 2023 @02:50PM
(#34657514)
Finding a single counterexample does not disprove correlation or predictive ability. A hiring test can have both false positives and false negatives and still be useful.
Re:ChatGPT Passes Google Coding Interview for Level 3 Engine...
by l33t233372 on Saturday February 04, 2023 @04:26PM
(#34658478)
Itβs possible that being able to pass the interview is indicative of performance in humans but not in LLMs.
Humans think differently from LLMs so it makes sense to interpret the same signal in different ways.
Aren't these kind of mutually exclusive, at least directionally? If the interview is meaningful you'd expect it to predict job performance. If it can't predict job performance then it is kind of useless.
I guess you could play some word games here to occupy a middle ground ("the coding interview is kind of useful, it measures something, just not job performance exactly") but I can't think of a formulation where this doesn't sound pretty silly.