News for hackers. Stuff that matters.
Re:An Elixir/LiveView game written entirely by ChatGPT by ninkendo on Saturday December 03, 2022 @01:12PM (#33845758)
I pasted in the question I typically ask candidates at $dayjob. It did better than the vast majority of candidates. (It’s a very open ended architectural question that’s specific to the industry I’m in.)

At the end I said “write it in Rust” and it wrote a plausibly good implementation.

I’m not sure I can trust remote interviews any more…

Re:An Elixir/LiveView game written entirely by ChatGPT by qzw on Saturday December 03, 2022 @02:37PM (#33846538)
Actually it sounds like recruiting just got a lot easier for you!
Re:An Elixir/LiveView game written entirely by ChatGPT by abecedarius on Saturday December 03, 2022 @03:01PM (#33846735)
That's close to answering a question from a bit over a year ago: "in 5 years will there be an AI that's better than 90% of unassisted working programmers at solving new leetcode-type coding interview questions posed in natural language?" https://news.ycombinator.com/item?id=29020401

It didn't get a very welcoming reception -- "highly unlikely", and the tenor of other opinions in those comments then tended the same way. But I was being too conservative. (I thought so at the time but it felt sort of outside an Overton window of reasonable technology opinions.)

Re:An Elixir/LiveView game written entirely by ChatGPT by imtringued on Sunday December 04, 2022 @05:35AM (#33852367)
What? Leetcode is purely about memorization. Of course a model trained on those solutions will regurgitate them. That how humans do it!
Re:An Elixir/LiveView game written entirely by ChatGPT by abecedarius on Sunday December 04, 2022 @11:36AM (#33855134)
you missed the word 'new'
Re:An Elixir/LiveView game written entirely by ChatGPT by naiv on Saturday December 03, 2022 @03:51PM (#33847212)
Same here. It passed the tests for backend / frontend and created perfect unit tests as well.
Re:An Elixir/LiveView game written entirely by ChatGPT by xrd on Saturday December 03, 2022 @04:36PM (#33847631)
But if it's a remote job, won't that same developer do great by just delegating all their tasks to the AI, just like they did in the interview? Crazy stuff.
Re:An Elixir/LiveView game written entirely by ChatGPT by astrange on Saturday December 03, 2022 @11:31PM (#33850630)
I asked my usual question and it got the answer wrong, but in a believable way that it could’ve learned on stackoverflow.

(Basically it tried to parse HTML with regexes.)