News for hackers. Stuff that matters.
Re:An Elixir/LiveView game written entirely by ChatGPT by BurnerBotje on Saturday December 03, 2022 @12:14PM (#33845075)
I tried to copy paste the Advent of Code puzzles into the chat, and it just spewed out code that worked like it was nothing. It worked for the day 1 and day 2 puzzels. I’m impressed it also “remembered” that I wanted the result as JavaScript
Re:An Elixir/LiveView game written entirely by ChatGPT by bugfix-66 on Saturday December 03, 2022 @12:36PM (#33845295)
How many of the 40 puzzles here can it solve: https://BUGFIX-66.com

Copilot can solve a few, mainly just simple matrix multiplication and radix sorting that appear dozens of times in its training set.

Can it understand the Harwell-Boeing sparse matrix format?

https://bugfix-66.com/cb75bc9d9f331733904d9c4a2a7782f98fb058...

BUGFIX-66 is a fair test. Give it something quite straightforward that mostly wasn't in its training set (except some of the puzzles near the beginning) and make sure a bullshit answer is marked wrong.

So, how does it do?

Re:An Elixir/LiveView game written entirely by ChatGPT by EMIRELADERO on Saturday December 03, 2022 @01:13PM (#33845772)
Why are you so snarky? Yes, of course this won't solve things it has never seen in its training set. It's not an AGI. But so what? It's still amazing nontheless. Is your point that since it's not "intelligent" we should dismiss it?
Re:An Elixir/LiveView game written entirely by ChatGPT by buzzerbetrayed on Saturday December 03, 2022 @01:54PM (#33846182)
I had to go back and reread GPs comment because I didn’t sense any snark the first time. Still not sure if I do.
Re:An Elixir/LiveView game written entirely by ChatGPT by bugfix-66 on Sunday December 04, 2022 @12:16AM (#33850833)
That's right. There was no snark intended.
Re:An Elixir/LiveView game written entirely by ChatGPT by cercatrova on Saturday December 03, 2022 @02:02PM (#33846240)
I've interacted with that account before and they were always snarky, as if their test they made is the arbiter of intelligence and that we shouldn't be so impressed by AI that to me is actually impressive.
Re:An Elixir/LiveView game written entirely by ChatGPT by bugfix-66 on Sunday December 04, 2022 @12:27AM (#33850890)
You don't test on the training set.

Everybody in ML (e.g., me) knows that.

But that's what we're seeing.

I'm saying: "Here's a test outside the training set."

Re:An Elixir/LiveView game written entirely by ChatGPT by NavinF on Saturday December 03, 2022 @02:18PM (#33846361)
He's just spamming his website in every thread related to ML. The snark gets more attention.
Re:An Elixir/LiveView game written entirely by ChatGPT by bugfix-66 on Sunday December 04, 2022 @12:20AM (#33850856)
Navin Francis (https://images.app.goo.gl/67vyDZQMzAHvVVci6).

We're practically neighbors, and I am looking forward to the day we meet face-to-face.

It will be an heated discussion and I expect a sincere apology from you for your outrageous behavior.

Re:An Elixir/LiveView game written entirely by ChatGPT by dang on Sunday December 04, 2022 @02:18AM (#33851386)
You can't do this here. I've banned the account, and have redacted the identifying info from your comment.

https://news.ycombinator.com/newsguidelines.html

Re:An Elixir/LiveView game written entirely by ChatGPT by NavinF on Sunday December 04, 2022 @02:42AM (#33851508)
Ooh could you email me what he said? It's in my profile. Really curious what sort of identifying info of me he was showing off.
Re:An Elixir/LiveView game written entirely by ChatGPT by jasonjmcghee on Saturday December 03, 2022 @03:31PM (#33847002)
For what it's worth, this is likely one of the easier puzzles you could give it because there are so many solutions in a number of languages all over the web.
Re:An Elixir/LiveView game written entirely by ChatGPT by avarun on Saturday December 03, 2022 @03:52PM (#33847221)
The training set is limited to 2021 and earlier and it sounds like the GP asked for solutions to yesterday's Advent of Code puzzle.
Re:An Elixir/LiveView game written entirely by ChatGPT by BurnerBotje on Saturday December 03, 2022 @05:20PM (#33848054)
Yes correct. It does however still explain in detail what needs to happen (I omitted the results for the sample data’s).