News for hackers. Stuff that matters.

A comment on Interviews in the Age of AI: Ditch Leetcode – Try Code Reviews Instead. Parent comment

Re:Interviews in the Age of AI: Ditch Leetcode – Try Code Re... by pedrosorio on Tuesday October 17, 2023 @12:55PM (#37917992)
> There are probably about 30 or so leetcode problems and then endless variations made for those 30 problems. The best people on leetcode practice and memorize.

The comment I replied to claimed that "LLMs would do pretty well at leetcode interviews". OpenAIs own report [0] shows how GPT-4 fails miserably at medium/hard leetcode problems that are not in the training data.

[0] https://cdn.openai.com/papers/gpt-4.pdf

[ Parent | on HN ]
Re:Interviews in the Age of AI: Ditch Leetcode – Try Code Re... by postalrat on Wednesday October 18, 2023 @03:42PM (#37933738)
I wouldn't consider doing 31/41 easy problems, 21/80 of medium problems, and 3/45 of hard problems a failure. GPT-4 wasn't built to solve these problems but can still do 3 of 45 hard problems. Hell I don't know if you sat down 45 random programmers if 3 of them could solve those 3 problems GPT-4 was able to do, and nobody could solve them in the time it took GPT-4.
[ Parent | on HN ]