News for hackers. Stuff that matters.
Re:Can GPT-4 *Actually* Write Code? by whateveracct on Friday March 17, 2023 @02:32AM (#35193921)
the big thing to me is programming isn't hard

I've worked on adtech, crypto, fintech, gamedev, startup founder, BigCo. Not once was programming something that was a time sink.

Makes me feel like GPT is marketing to the incompetent or something.

Re:Can GPT-4 *Actually* Write Code? by copperx on Friday March 17, 2023 @02:46AM (#35194019)
> Not once was programming something that was a time sink.

Can you please expound on that? Do you mean not hard as in comparison to something else?

Re:Can GPT-4 *Actually* Write Code? by noitpmeder on Friday March 17, 2023 @02:58AM (#35194104)
I think all it shows is that GP has never worked on complicated problems that require anything more than gluing libraries together.
Re:Can GPT-4 *Actually* Write Code? by Jensson on Friday March 17, 2023 @03:09AM (#35194168)
If you do nontrivial coding then GPT wont help you, so that isn't relevant for the discussion.
Re:Can GPT-4 *Actually* Write Code? by noitpmeder on Friday March 17, 2023 @03:16AM (#35194218)
I disagree. GP, by their statement and appeal "I've worked on adtech, crypto, fintech, gamedev, startup founder, ...", implies that he has worked on complicated software issues, and that he thinks GPT is a promising replacement for developers working on those problems.
Re:Can GPT-4 *Actually* Write Code? by Jensson on Friday March 17, 2023 @03:23AM (#35194271)
> implies that he has worked on complicated software issues

No it doesn't, there is a lot of simple "gluing APIs together" to do in all of those. The hard part then is figuring out what you want to do, not getting the code to do it.

Re:Can GPT-4 *Actually* Write Code? by whateveracct on Friday March 17, 2023 @01:59PM (#35200526)
Opposite.

I did a startup for years and the backend was all boring Golang talking to Postgres. I am confident that if GPT had produced identical code it would've been worse. Because shit hit the fan many times due to misunderstandings or other things that cause bugs. Because I wrote the bugs, I was able to fix them. Making coding more of a blackbox and treating coding as menial labor would have definitely caused us to lose customers and miss important deadlines.

Maybe the next way to move the goalposts is "GPT will debug for you someday and be trained on the entire transitive closure of your dependencies."

That sort of thing could actually be useful as a sort of hint, but it isn't replacing devs any more than ripgrep did. To be honest, ripgrep through the source of my deps is already highly efficient and points me to things often.

Re:Can GPT-4 *Actually* Write Code? by whateveracct on Friday March 17, 2023 @06:57PM (#35204008)
I have built plenty of complicated things that were much more than glue. Even for those, coding was far from a bottleneck. Because coding is easy.

In fact, all the complicated software anecdotes I could give were things that ChatGPT wouldn't even touch. In the realm of design and scaling and fault tolerance and other such things.

Re:Can GPT-4 *Actually* Write Code? by Jensson on Friday March 17, 2023 @02:46AM (#35194024)
Exactly, we know how much code gets written per programmer hour, its in the single digits on average. Speeding that up wont make a big difference.
Re:Can GPT-4 *Actually* Write Code? by hungryforcodes on Saturday March 18, 2023 @02:42PM (#35211884)
Single digits what? What are you measuring here? Files, lines, KLOCs?
Re:Can GPT-4 *Actually* Write Code? by Peritract on Friday March 17, 2023 @05:34AM (#35194954)
> Makes me feel like GPT is marketing to the incompetent or something.

Absolutely. The common constant I can see in people who are really blown away by GPT's performance at [task] is that they are bad at [task].

Programmers who describe their job as copying from StackOverflow think it's great at coding. People who don't read fiction think it's great at writing fiction, and so on.

Re:Can GPT-4 *Actually* Write Code? by Winsaucerer on Friday March 17, 2023 @07:43AM (#35195695)
That's not accurate at all for me. I'm not impressed with the output when rating it against humans who are good at said task. It's obviously not as good as those who are good in that relevant field.

But it's certainly far better than humans who are not skilled at those tasks, and that is what I find to be very impressive. I just didn't realise that these models could be this good, and they're not even as good as they will be.

I guess if you were expecting something that's going to be as good as those who are skilled in a particular field, you'll be unimpressed -- but I wasn't even expecting mediocrity.

Re:Can GPT-4 *Actually* Write Code? by Peritract on Friday March 17, 2023 @09:07AM (#35196580)
I think we're talking at cross-purposes here. I'm not underwhelmed by it being not as good as good humans at [task]; that's not a surprise.

I'm saying that most people I see who are impressed by it for any given task are people who are not well-equipped to judge performance on that task.

Re:Can GPT-4 *Actually* Write Code? by Sunhold on Friday March 17, 2023 @09:36AM (#35196884)
I'm impressed by the talking dog because it's a dog that can talk, not because I think it's a great orator.
Re:Can GPT-4 *Actually* Write Code? by Peritract on Friday March 17, 2023 @02:05PM (#35200618)
I trust that you're familiar enough with dogs to tell barking apart from talking.
Re:Can GPT-4 *Actually* Write Code? by brookst on Friday March 17, 2023 @08:17AM (#35196064)
Many people are blown away by GPT for the leverage it provides, not because it makes the impossible possible.

Programming is generally not hard. Producing 5x - 10x as much programming output at the same quality is quite hard. And keeping the most interesting 10% for yourself while offloading the 90% that is basically just typing? That’s what people are excited about.