News for hackers. Stuff that matters.
Re:Testing how hard it is to cheat with ChatGPT in interviews by outside415 on Wednesday January 31, 2024 @04:45PM (#39209835)
Me and several friends have used ChatGPT in live interviews to supplement answers to topics we were only learning in order to bridge the gap on checkboxes the interviewer may have been looking for.

We’ve all got promotions by changing jobs in the last 6 months using this method.

You can be subtle about it if it’s already an area you kind of know.

Re:Testing how hard it is to cheat with ChatGPT in interviews by al_borland on Wednesday January 31, 2024 @05:03PM (#39210040)
I like when a person admits they don’t know something in an interview. It shows they aren’t afraid to admit when they don’t have the answer instead of trying to lie their way through it and hoping they don’t get caught. Extra bonus points if they look the thing up later to show they are curious and want to close knowledge gaps when they become aware of them.

People who are unwilling to say, “I don’t know, let me look into that,” are not fun to work with. After a while it’s hard to know what is fact vs fiction, so everything is assumed to be a fabrication.

Re:Testing how hard it is to cheat with ChatGPT in interviews by jedberg on Wednesday January 31, 2024 @07:00PM (#39211253)
When I was 11 I took a live assessment to get into the gifted program at school. I thought I didn't do very well because about 20% of the questions I answered "I don't know".

At the end the assessor told me that I passed specifically because I said "I don't know". They purposely put questions on the test they didn't expect you to answer to see what you do when faced with an unanswerable question.

I've used that in my own life since -- I much prefer working with (and have a much more positive view of) people who are willing to say "I don't know".

Re:Testing how hard it is to cheat with ChatGPT in interviews by BeFlatXIII on Thursday February 01, 2024 @01:16PM (#39219225)
Doesn't the SAT work similarly? They penalize wrong answers to discourage guessing. Either be confident in your answer or leave the question blank.
Re:Testing how hard it is to cheat with ChatGPT in interviews by jedberg on Thursday February 01, 2024 @01:41PM (#39219535)
I assume so, at least it worked that way when I took it 30 years ago.
Re:Testing how hard it is to cheat with ChatGPT in interviews by JohnFen on Wednesday January 31, 2024 @05:56PM (#39210601)
I couldn't agree more. When I am interviewing candidates, one of the things that I'm looking for is that the applicant is willing to say "I don't know" when they don't know. That's a positive sign. If they follow that up with a question about it, that's even better.

If a candidate is trying to tap-dance or be vague around something to avoid admitting ignorance of it, that's a pretty large red flag.

Re:Testing how hard it is to cheat with ChatGPT in interviews by KTibow on Wednesday January 31, 2024 @05:26PM (#39210308)
You could argue that researching it then and there proves that you know how to learn stuff quick. I agree that there should be disclosure though.
Re:Testing how hard it is to cheat with ChatGPT in interviews by noddingham on Wednesday January 31, 2024 @06:50PM (#39211173)
I'm going to be pedantic and challenge your use of the word 'learn' here. I tend to agree with the notion that being able to say 'I don't know, let me find out' and then find out quickly with a correct answer is in general a Good Thing™, but I wouldn't equate that with learning the thing they just looked up.
Re:Testing how hard it is to cheat with ChatGPT in interviews by smcin on Wednesday January 31, 2024 @11:14PM (#39212658)
The difference between 'learn', 'cram', 'regurgitate' etc. depends on the level of understanding required, and the length of the recall.

And whether the interview is just asking definitions or silly certification questions, or things requiring deeper understanding.

Re:Testing how hard it is to cheat with ChatGPT in interviews by al_borland on Wednesday January 31, 2024 @05:45PM (#39210479)
Yeah, the disclosure is very important. It’s the difference between an open book test and notes written on their thigh.

During some interviews I’d give people access to a computer. If they could quickly find answers and solve problems, that is a skill in itself, but I could see what they were looking up. Sometimes that part would make or break the interview. Some people didn’t have a deep base of knowledge in the area we were hiring for, but they were really good at finding answers, following directions, and implementing them successfully. They would be easy to train on the specifics of the job. Other people couldn’t Google their way out of a paper bag, I was shocked at how bad some people were and looking up basic things. Others simply quit without even attempting to look things up.

Re:Testing how hard it is to cheat with ChatGPT in interviews by kjkjadksj on Thursday February 01, 2024 @12:27AM (#39212970)
For every one person hiring with your mentality there are a hundred other managers looking to cut down the stack of a thousand resumes in any trivially easy way they can. That starts with saying sorry we are looking for someone else when you say you don’t know x or lack z on your resume. You are literally incentivized to lie and fake it on the job.
Re:Testing how hard it is to cheat with ChatGPT in interviews by outside415 on Thursday February 01, 2024 @03:05PM (#39220632)
while I agree with you in the context of a work environment 100%, in an interview there is a series of checkboxes interviewers need to hear and if you say I don't know I will look into that you can really screw yourself.
Re:Testing how hard it is to cheat with ChatGPT in interviews by jacques_chester on Wednesday January 31, 2024 @04:53PM (#39209931)
So, assuming they didn't know and approve, you cheated.
Re:Testing how hard it is to cheat with ChatGPT in interviews by lcnPylGDnU4H9OF on Wednesday January 31, 2024 @05:03PM (#39210046)
Dirty, dirty cheater! Sounds like they would have been able to perform the job duties so I'm not sure why one should care.
Re:Testing how hard it is to cheat with ChatGPT in interviews by dataflow on Wednesday January 31, 2024 @05:27PM (#39210311)
There is literally not enough information to tell if they can perform their job duties or not.
Re:Testing how hard it is to cheat with ChatGPT in interviews by lcnPylGDnU4H9OF on Wednesday January 31, 2024 @05:58PM (#39210616)
It's a fair point that I am making this assumption. At any rate, my comment could instead read:

> [If one assumes that the candidate] would have been able to perform the job duties I'm not sure why [they] should care.

This is what I mean; I can see why an interviewer thinks they've been cheated or that a candidate was dishonest but that doesn't mean that the interviewer even has a successful system for determining if a candidate can perform the job duties. A candidate who cheated -- from the perspective of the interviewer, I guess -- but still manages to adequately perform in their role very plainly did not cheat from a less biased perspective. What is that interviewer even thinking? How could that person have cheated?

Re:Testing how hard it is to cheat with ChatGPT in interviews by staunton on Wednesday January 31, 2024 @08:57PM (#39212001)
> determining if a candidate can perform the job duties. A candidate who cheated -- from the perspective of the interviewer, I guess -- but still manages to adequately perform in their role very plainly did not cheat

That's not what anyone means when they say "cheating". Cheating means to violate the conditions and assumptions of an examination or contest.

For example, if a chess grandmaster uses an AI implant to win a game and gets caught, it doesn't make it OK if they could consistently win against the same opponent even without the AI.

Re:Testing how hard it is to cheat with ChatGPT in interviews by lcnPylGDnU4H9OF on Wednesday January 31, 2024 @09:19PM (#39212126)
Okay, that does make the position more understandable but I still don’t quite get it. Perhaps more accurately, I see these assumptions which others don’t necessarily share. The people claiming cheater have different opinions from the supposed cheaters.

I recall a Starcraft 2 match[0] involving a person with an apparently psychosomatic wrist injury that was only painful while they’re playing on stage. Their opponent was seeming to draw out a game they were losing in an attempt to trigger the pain; it was a viable strategy given the “best of” series they were playing. That’s certainly not going to be accounted for in the rules and one might believe that it’s an underhanded way to win. But both players are in the top echelons of game knowledge, experience, and skill; that’s the only reason either player made it to this particular match-up. The player with the wrist injury ultimately had it act up and lost the series.

Did the winner deserve to win? Should the other player be considered the better player? The assumptions of the game rules and what’s “fair” might be different per player; who’s right, who’s wrong, and why? What about when prize money is involved; that guy who won by the written rules just doesn’t deserve it because of unspoken rules? These questions don’t seem to have obvious answers, so of course I challenge assumptions.

0: I’m looking for the VOD I watched. Edit: I believe it was here: https://www.youtube.com/watch?v=DS2XIyNDlSA

Re:Testing how hard it is to cheat with ChatGPT in interviews by dataflow on Wednesday January 31, 2024 @10:08PM (#39212369)
You're completely ignoring the fact that honesty (& willingness to follow rules you might otherwise disagree with, etc.) themselves might be traits the employer is looking for in that role. Traits that (by your willingness to break the rules) you're obviously lacking. They just don't happen to be technical skills, but that doesn't mean they don't matter to the employer. What do you think you're doing by cheating? You're deceiving them into hiring someone with traits they explicitly don't want. You don't see a problem with that?
Re:Testing how hard it is to cheat with ChatGPT in interviews by lcnPylGDnU4H9OF on Wednesday January 31, 2024 @11:51PM (#39212822)
> You're completely ignoring

There are nicer ways to express your meaning. I haven’t ignored anything.

These traits are often not offered by the employer. Why do I keep hearing people talk about the underhanded ways that companies try to obfuscate salary budgets if not because they’re dishonest? I certainly see that as dishonesty; where are they coming from to demand such honesty from their candidates?

They get honesty anyway but that doesn’t mean I can convince them of it. If a person wants to assume guilt in someone, that is often what happens. You may not have experienced a person power-tripping over you but that’s been a good portion of my life and it’s hard to miss the patterns in a modern job interview.

To be clear, I’m not advocating for one to be dishonest. The person using ChatGPT to supplement their knowledge is not being dishonest; that’s my claim. The interviewer feels like the candidate “cheated”. Oh well. Too bad the interviewer isn’t above pejoratives. Gotta call it “cheating” so they can dismiss the candidate as dishonest. How dishonest!

Re:Testing how hard it is to cheat with ChatGPT in interviews by JohnFen on Wednesday January 31, 2024 @05:59PM (#39210631)
People care because such a person isn't terribly trustworthy. There's more to being a valuable employee than just being able to perform the job duties.
Re:Testing how hard it is to cheat with ChatGPT in interviews by ThrowawayR2 on Wednesday January 31, 2024 @05:21PM (#39210251)
Those who lie about one thing are likely to lie about many others.
Re:Testing how hard it is to cheat with ChatGPT in interviews by InvertedRhodium on Wednesday January 31, 2024 @05:58PM (#39210628)
Given that literally every person alive lies about some things, I'm not sure how much value that observation brings to the discussion.
Re:Testing how hard it is to cheat with ChatGPT in interviews by sethammons on Thursday February 01, 2024 @05:07AM (#39214374)
Curious outlook. I, for one, avoid lying. The closest I get is omission. I'm not interested in remembering false realities depending on the person I'm talking with. The last lie I recall was a number of years ago where I said to a store clerk that I had recently been somewhere when in fact it was not very recent. Immediately after I felt bad. I value honesty.
Re:Testing how hard it is to cheat with ChatGPT in interviews by InvertedRhodium on Thursday February 01, 2024 @11:14PM (#39224937)
Lying is such a fundamental part of human psychology that we lie to ourselves without even knowing we're doing it, and children learn to lie without any instructions. I wouldn't go so far as to say that it's instinctual, but it's very close to it.

Taking it even a step further - your memory is imperfect, the degree to which you can accurately recall events is significantly poorer than most people believe, which leads to incidental lies. We call them mistakes, but from the outside perspective that's just a question of intent.

That being said, despite my pessimism towards human nature, I too value honesty. But, like everyone, I lie occasionally - and I note that you don't claim to not lie, nor to have never lied. I'd call it honesty on a best efforts basis.

Re:Testing how hard it is to cheat with ChatGPT in interviews by jacques_chester on Wednesday January 31, 2024 @05:08PM (#39210102)
That someone has the skills for a job is distinct from whether they are able to uphold a simple moral principle like "don't cheat".
Re:Testing how hard it is to cheat with ChatGPT in interviews by lcnPylGDnU4H9OF on Wednesday January 31, 2024 @05:14PM (#39210163)
The interviewer is full of themself if they think someone who can do the job cheated in the interview.
Re:Testing how hard it is to cheat with ChatGPT in interviews by jurynulifcation on Wednesday January 31, 2024 @05:30PM (#39210342)
That job could have gone to someone who like actually knew what they were doing and was honest lol not sure why you want to defend professional and intellectual dishonesty?
Re:Testing how hard it is to cheat with ChatGPT in interviews by lcnPylGDnU4H9OF on Wednesday January 31, 2024 @05:35PM (#39210388)
> intellectual dishonesty

This suggestion that a person who can adequately perform job duties could have even possibly cheated in their job interview is intellectually dishonest. If they had to cheat to get the job we should be looking at the interviewer. Why did the qualified candidate have to cheat? Why is whatever-they-did even considered cheating?

Re:Testing how hard it is to cheat with ChatGPT in interviews by JohnFen on Wednesday January 31, 2024 @06:02PM (#39210670)
> Why did the qualified candidate have to cheat?

If they're qualified, they didn't have to cheat. If they're not, then they did. Either way, they're dishonest and that means they're not a desirable hire.

Re:Testing how hard it is to cheat with ChatGPT in interviews by lcnPylGDnU4H9OF on Wednesday January 31, 2024 @06:19PM (#39210856)
> If they're qualified, they didn't have to cheat.

(Just rewriting to specify my understanding: If the candidate was qualified, they didn't have to cheat even if they did cheat. They could have simply not cheated and been selected by the merits of their qualifications.)

This argument relies on the false premise that an interviewer will always accurately determine a candidate's qualifications. That a candidate is not qualified to pass an interview is not the same that a candidate is not qualified for the job for which they're being interviewed.

Re:Testing how hard it is to cheat with ChatGPT in interviews by JohnFen on Wednesday January 31, 2024 @06:56PM (#39211219)
True, most interviewing processes are very imperfect by necessity and some qualified people will be mistakenly filtered out.

But also, there are usually several-to-many applicants for a position that are all qualified, and by necessity most of them won't get the position.

Additionally, technical qualifications is only a part of what an employer is looking for. There are other things that are at least equally important -- how well the applicant would fit into the team, how trustworthy they are, etc. It's about a lot more than just technical skillset.

Re:Testing how hard it is to cheat with ChatGPT in interviews by lcnPylGDnU4H9OF on Wednesday January 31, 2024 @07:45PM (#39211608)
> True, most interviewing processes are very imperfect by necessity and some qualified people will be mistakenly filtered out.

This is ultimately something I see as dishonest given the context of job applications. Employers generally expect a certain kind of perfection from job candidates, which they can’t manage to show of themselves. I understand that this isn’t an easy thing to solve -- nor even something that’s ever been solved -- but that should at least make it more understandable when an otherwise qualified candidate uses disallowed tools in their interview.

Perhaps the candidate’s real best option is to find a different company to work for but they may not be so privileged as to have a choice if their on-paper qualifications are lacking. Assuming their practicable qualifications are adequate, they may have good reason to bullshit through a bad interview. Additionally, finding a different company is pretty likely to be “same shit, different day”.

> But also, there are usually several-to-many applicants for a position that are all qualified, and by necessity most of them won't get the position.

Assuming they’ve qualified via an interview and there are particularly close candidates, pick the one who applied first. They’re admittedly qualified and further interviewing is just a means of discriminating in error-prone and possibly unlawful or immoral ways.

> Additionally, technical qualifications is only a part of what an employer is looking for. There are other things that are at least equally important -- how well the applicant would fit into the team, how trustworthy they are, etc. It's about a lot more than just technical skillset.

Fair enough. I would caution interviewers against judging too harshly or quickly. One can imagine many reasons an interviewee might choose or seem to lie during an interview while they are otherwise an honest person, ranging from stress to disillusionment to [cultural differences](https://news.ycombinator.com/item?id=39209794).

At the end of the day, filtering for liars and cheaters actually filters for bad liars and cheaters in addition to people who are a bit nervous or tired or stressed or cynical or just having a slightly off day; dishonest people who genuinely see nothing wrong with dishonesty get through just fine.

Re:Testing how hard it is to cheat with ChatGPT in interviews by yieldcrv on Wednesday January 31, 2024 @10:44PM (#39212532)
Tech hiring is way too dicey right now to give af, and its what I would do on the job anyway, most likely a local ai when company code is involved
Re:Testing how hard it is to cheat with ChatGPT in interviews by outside415 on Thursday February 01, 2024 @03:08PM (#39220680)
I disclosed my use of chatgpt throughout the process and the hiring manager was excited that I was on the cutting edge. I used it for the project they gave me as well. :)

I don't think my friends disclosed that they were using it.

Re:Testing how hard it is to cheat with ChatGPT in interviews by jacques_chester on Sunday February 04, 2024 @03:21PM (#39254006)
Thank you for the clarification. I am glad you disclosed and disappointed your friends didn't.
Re:Testing how hard it is to cheat with ChatGPT in interviews by jurynulifcation on Wednesday January 31, 2024 @05:29PM (#39210336)
Re:Testing how hard it is to cheat with ChatGPT in interviews by moshun on Wednesday January 31, 2024 @07:13PM (#39211343)
To be fair, you were likely already getting out competed by people with better connections or social skills anyway. Years in corporate leadership has cleansed me of the notion that merit is required to be a major factor in hiring decisions.
Re:Testing how hard it is to cheat with ChatGPT in interviews by mattbaker on Wednesday January 31, 2024 @06:07PM (#39210733)
I don't think your comment is in line with HN guidelines, you might consider making edits.

https://news.ycombinator.com/newsguidelines.html

Re:Testing how hard it is to cheat with ChatGPT in interviews by smcin on Wednesday January 31, 2024 @10:56PM (#39212587)
Is this junior/intermediate software engineer, or what? What sort of questions? CS exam-type, definitions, whiteboarding, programming, LeetCode, numerical problems, algorithm, data structures...? Programming-language certifications? Riddles?