News for hackers. Stuff that matters.
Re:Can GPT-4 *Actually* Write Code? by maxdoop on Friday March 17, 2023 @02:27AM (#35193892)
I don’t think you’ve tried GPT-4.

If you have, I don’t think you are like majority of devs (maybe not on HN, but in real life).

You sound lucky to have true, novel problems to solve each day. I’m with many here commenting that this is quite powerful stuff, especially when my day-to-day is writing simple CRUD apps, or transforming data from one format to another within an API, or configuring some new bit of infra or CI/CD.

I’d love to be challenged in some new way, and have access to truly fascinating problems that require novel solutions. But most enterprises aren’t really like that nor do that need that from majority of engineers.

Re:Can GPT-4 *Actually* Write Code? by nitwit005 on Friday March 17, 2023 @02:36AM (#35193937)
If all you're doing is very simple crud apps and transforming API responses, your coding is already replaceable with "no code" tools.
Re:Can GPT-4 *Actually* Write Code? by theshrike79 on Friday March 17, 2023 @03:16AM (#35194210)
I'm still waiting for the no-code tools that can replace me, the API Glue Coder.

They've been promising those since the early 2000's, but I'm still employed.

Some stuff has been automated by Zapier, IFTTT and the like, but most of the systems I'm integrating with don't have public APIs.

Re:Can GPT-4 *Actually* Write Code? by joenot443 on Friday March 17, 2023 @08:38AM (#35196291)
"I'm still waiting for the automobile that can replace me, the Horse Carriage Driver. They've been promising those since the 1880s, but I've still got passengers in my carriage every day!"

Obviously it's a cheeky example, but this would not be the first time in history a previously well-established career was upended in a (relatively) short amount of time. I'm a FAANG dev, I've got skin in the game too and I'm trying to be optimistic, but I can't help but be at least a little worried. From Wikipedia -

"In 1890 there were 13,800 companies in the United States in the business of building carriages pulled by horses. By 1920, only 90 such companies remained."

I don't think we'll be out of the job entirely, but I can definitely imagine the bar being raised and the compensation stagnating as we now have to justify the time and cost of our work compared to the near-free, near-instantaneous output of an LLM.

All that being said, if you've been working since the 2000s, you've got nearly a 20 year head-start on me, so perhaps it makes sense for me to be a bit more worried.

Re:Can GPT-4 *Actually* Write Code? by theshrike79 on Friday March 17, 2023 @08:55AM (#35196468)
> All that being said, if you've been working since the 2000s, you've got nearly a 20 year head-start on me, so perhaps it makes sense for me to be a bit more worried.

Yea, that's mostly why I get hired. Experience gives people a certain intuition on what kind of solutions work for which cases.

And when you've been working long enough, you don't (hopefully) feel the need to do cool bleeding edge shit at work, you just want the work code to ... work. You pick the simplest and most boring solution possible so you can clock out at 1600 and not think about services crashing because the newfangled thingamageek coded with the latest language du jour failed because of an edge case nobody has seen before.

Re:Can GPT-4 *Actually* Write Code? by joenot443 on Friday March 17, 2023 @10:26AM (#35197547)
That's a comforting perspective, I hope that you're right.
Re:Can GPT-4 *Actually* Write Code? by illiarian on Friday March 17, 2023 @09:11AM (#35196613)
> I'm still waiting for the automobile that can replace me, the Horse Carriage Driver.

Wow. The hype around "AI"s has entered the crypto stages. Just like crypto was the new car, the new internet etc., so is AI now.

Well, at least AI is useful in certain applications.

Re:Can GPT-4 *Actually* Write Code? by AstralStorm on Friday March 17, 2023 @09:17AM (#35196690)
Again? Last time it ended in a long winter.

And horse carriages have some serious advantages, maybe even will make a comeback. :)

Re:Can GPT-4 *Actually* Write Code? by joenot443 on Friday March 17, 2023 @10:29AM (#35197577)
I got into and out of Bitcoin back in 2010 when I was still in high school. Even then, I thought and still do that crypto as a whole is a complete ponzi scheme with little real world utility.

I feel completely differently about LLMs; I'd say we're closer to 2007 when the first iPhone was released. I believe LLMs will become a part of our day to day lives at a level that crypto never came close to.

Re:Can GPT-4 *Actually* Write Code? by saurik on Monday March 20, 2023 @01:08AM (#35227522)
But horse carriage drivers were never out of a job, because cars still needed people to drive them... (yes, people can drive their own car, but they can also drive their own carriage, so nothing is different there). In contrast, horses were out of a job; do you think we are more like horses than like the people who drive horses?
Re:Can GPT-4 *Actually* Write Code? by bboygravity on Friday March 17, 2023 @03:21AM (#35194257)
Except it isn't and it won't be until 10 layers of management learn what no-code tools are and why they should want them.
Re:Can GPT-4 *Actually* Write Code? by vincnetas on Friday March 17, 2023 @03:33AM (#35194321)
And i guess this will never happen as management at the first sign of trouble making AI do that they want, will gladly pay someone else to do it for them. Of course as little as possible, but either way they will be glad to delegate.

It's same for me. I can learn how to tile my bathroom or repair my car, but i just don't feel like and am happy to pay someone else.

Re:Can GPT-4 *Actually* Write Code? by illiarian on Friday March 17, 2023 @09:09AM (#35196595)
I've been a programmer for 23 years now. In all these years every year was the year of no-code tools.

And you know what? We went from having actual no- or low-code tools (UI builders, forms in Access and FoxPro etc.) to zero no-code tools worth a damn [1]. There was a brief dream of Yahoo! Pipes in mid-to-late 2000s, but it's dead as well.

[1] Except some applications like Unreal Blueprints and similar node-based tools in audio and graphical software

Re:Can GPT-4 *Actually* Write Code? by eestrada on Friday March 17, 2023 @11:50PM (#35205871)
I think the reason Unreal Blueprints and cousins work and are useful is: they are used in a relatively narrow domain, the primitives of that domain are well understood/defined, and the primitives are easily compossible.

Once you create a general purpose no-code option, it is so complicated and sprawling that the mental burden to understand it is just as great (if not greater) as just using plain old code again. Or conversely, it is so constraining (for the sake of "simplicity") that it can't do anything useful.

Re:Can GPT-4 *Actually* Write Code? by weatherlite on Friday March 17, 2023 @04:19PM (#35202340)
> If all you're doing is very simple crud apps and transforming API responses,

I think all of us here conflate simple with easy. It's simple in theory yes - you get some JSON from service X, maybe tweak service Y that talks to X and then feed it into some front end. In practice even very experienced engineers can take days writing or changing a simple end point or some front end because unclear requirements/bugs/micro service hell/unclear existing code/etc etc.

If it was that easy the pace and quality would have been much higher than what I'm seeing in tech companies.

Re:Can GPT-4 *Actually* Write Code? by whateveracct on Friday March 17, 2023 @02:30AM (#35193912)
There's not such thing as actually boring CRUD. I've worked at many companies and founded my own. Even when it felt like CRUD, a year+ in it was clear that tasteful decisions pay off and iteration and cost gradients matter. GPT doesn't sniff that.

I agree with GP - day 2 dev me outclasses it, which means it isn't replacing anyone.

Re:Can GPT-4 *Actually* Write Code? by anonzzzies on Friday March 17, 2023 @03:26AM (#35194287)
HN echo chamber. Generally the better/best programmers hang around here; your day 2 was probably better than many coders hope to achieve in their whole lives. It is replacing people already; I personally know about 10 people who have been fired or assigned to a completely different position because gpt did a faster and better or equal job. So ‘not anyone’ is simply nonsense; I am only one person, there will be many many more who see the same thing. Of course they are not told they are replaced by ai when fired, but their managers or more skilled colleagues know.

I do agree that there is no boring crud; that’s why gpt or no code tools are not good for full solutions (yet), but it’ll get there I am sure.

Re:Can GPT-4 *Actually* Write Code? by DaiPlusPlus on Friday March 17, 2023 @05:41AM (#35194986)
> I personally know about 10 people who have been fired or assigned to a completely different position because gpt did a faster and better or equal job

Please elaborate.

And, if true, this would be a major news story that Vox or any number of major newspapers would love to write about - so have you approached the media about this? If not, why not?

Re:Can GPT-4 *Actually* Write Code? by anonzzzies on Friday March 17, 2023 @07:05AM (#35195440)
> Please elaborate.

I simply know firsthand (i'm old, i have manager, cto, ceo friends who I go golf and play squash with) that people in data entry and programming have been let go in the past weeks because 1 person could take over their work using the gtp/chatgpt api's and do their work faster with less errors. I am recommending the same in my company as a lot of my colleagues are doing nothing anymore as the skilled seniors are doing it themselves with gpt now as it's faster, less communication etc. We feed jira issues into gpt and it generates code; we review and refine or fix ourselves. It works much much faster and with better results. Most things most of us do all day is integrating ancient API's of partners and so mapping xml/soap/... api's to our json schema's. With chatgpt that's really fast and mostly painless; it even renames the properties that need to be changed to our enums properly. With humans this is a painful and slow process, especially with people who are fast and loose (broken education seems to made many of those graduate just by cheer production speed & volume instead of quality; gpt can do that better too...).

> so have you approached the media about this? If not, why not?

Why would I do that? Even anonymous, it doesn't seem to make much sense for me to do that. Anyway; that'll come soon enough as it will be common soon.

Re:Can GPT-4 *Actually* Write Code? by oblio on Friday March 17, 2023 @09:12AM (#35196628)
How does this work from an IP perspective? Aren't you feeding OpenAI and Microsoft with your confidential information?

Also, what license is the code under when you get it back?

Re:Can GPT-4 *Actually* Write Code? by anonzzzies on Friday March 17, 2023 @09:52AM (#35197056)
I take care not to feed it secrets ; this is just boring ERP stuff without the magic numbers (they are not needed to create or test; we use test data normally as well, as we cannot give that to outsourcing companies either, so there is no difference in work).
Re:Can GPT-4 *Actually* Write Code? by oblio on Friday March 17, 2023 @10:22AM (#35197484)
And the output? Are you allowed to use their code for your own projects or company?
Re:Can GPT-4 *Actually* Write Code? by anonzzzies on Friday March 17, 2023 @03:37PM (#35201801)
Yes, we don’t all live in the US.
Re:Can GPT-4 *Actually* Write Code? by oblio on Friday March 17, 2023 @05:27PM (#35203143)
So you basically don't care about licensing.

That's ok for your use case but risky for anything open source of that might be sold around the world.

Re:Can GPT-4 *Actually* Write Code? by anonzzzies on Sunday March 19, 2023 @01:28PM (#35221384)
Not really, there is absolutely no way to show, let alone prove, any of it is written by AI.
Re:Can GPT-4 *Actually* Write Code? by davewritescode on Friday March 17, 2023 @09:18AM (#35196697)
> simply know firsthand (i'm old, i have manager, cto, ceo friends who I go golf and play squash with) that people in data entry and programming have been let go in the past weeks because 1 person could take over their work using the gtp/chatgpt api's and do their work faster with less errors. I am recommending the same in my company as a lot of my colleagues are doing nothing anymore as the skilled seniors are doing it themselves with gpt now as it's faster, less communication etc. We feed jira issues into gpt and it generates code; we review and refine or fix ourselves. It works much much faster and with better results.

This isn't software engineering work, this is 21st century data entry with some code. This is exactly the type of menial work that should be automated by AI.

If you have small self contained problems like map X -> Y then sure, ChatGPT will be sufficient. Where I disagree with you is calling these jobs "programming" jobs. These are the type of tasks that should've been written in a transform language like JOLT. This shouldn't even be code.

> With humans this is a painful and slow process, especially with people who are fast and loose (broken education seems to made many of those graduate just by cheer production speed & volume instead of quality; gpt can do that better too...).

Humans suck at repetitive menial tasks like this. It's not education's fault.

Re:Can GPT-4 *Actually* Write Code? by anonzzzies on Friday March 17, 2023 @09:50AM (#35197029)
> This isn't software engineering work, this is 21st century data entry with some code. This is exactly the type of menial work that should be automated by AI.

Who said it was? This is what most programmers do all day, that's the point. These people can be replaced now without writing specialised software for the case. It is programming, not software engineering and it is what people are doing all day long (and longer) who are called programmers / software engineers in most companies all over the world. You can disagree with it, but that doesn't change much.

So you are now putting the bar higher which is not fair; the fact is that people who have the title 'programmer' and even 'software engineer' are now readily replaced by AI. If you don't agree with the title; I don't either, but reality is what it is.

I would say basically the point is ; there are way way too many people being 'programmers' (but not limited to this field) who can be replaced; only a few % should remain as the rest does what you wouldn't call programming, but the rest of the world does. Search twitter for 'html programmer' and such. Millions and millions will never be programmers and your definition, but have a high paying job (for their country) working as a programmer.

Re:Can GPT-4 *Actually* Write Code? by suslik on Friday March 17, 2023 @08:50AM (#35196429)
Manager here. Did not fire anyone (and hope not to), but I am starting to look into implementing GPT-4 as a part of our development practice and, potentially, reduce future hiring. This might have a positive impact on our engineering budgets, which are always tight. Many of my colleagues are doing the same - this has been a cooler topic with other managers for weeks now (strange how progress is now measured in weeks).

At this point, this would only affect engineers who don't understand our subject area (biotech) and are relatively junior (in the sense that their output is not much better than a GPT4 output reviewed by a more senior dev).

Re:Can GPT-4 *Actually* Write Code? by anonzzzies on Friday March 17, 2023 @09:57AM (#35197127)
If your engineers are actually engineering then yes, really by all means keep them and integrate GPT in workflows as is suitable.
Re:Can GPT-4 *Actually* Write Code? by theK on Friday March 17, 2023 @02:47AM (#35194025)
On the flip side, I am having a great time charging enterprises exorbitant hourly rates to come in and help them fix their crappy crud programms.

But I still don’t know if I am thrilled by the prospect of being called in to make their monkeypatched, GPT generated project work.

Re:Can GPT-4 *Actually* Write Code? by anonzzzies on Friday March 17, 2023 @03:18AM (#35194229)
> their monkeypatched

You mean, like almost every outsourcing company pops over? So the type of code that infests companies who hired some sweatshop to do ‘some simple crud’? What’s the difference? Can you see the difference? Besides the gpt code will be far better commented as comments come for almost free with gpt while humans hate writing them.

Re:Can GPT-4 *Actually* Write Code? by theK on Friday March 17, 2023 @03:41AM (#35194361)
I think you can trust the code of both those worlds exactly the same, not at all.

I’ve seen GPT 3 and 4 hallucinate the most amazing commentary about their own output. Maybe we will get dependable, out of process, guidance at some point about how factual the model thinks it is on an output per output basis but until that point you should trust every LOC and comment exactly the same as code gifted to you by an adversary.

My modest 2¢

Re:Can GPT-4 *Actually* Write Code? by pms on Monday March 20, 2023 @02:10PM (#35235976)
Exactly... and then the question becomes: why do I interact with an adversary?
Re:Can GPT-4 *Actually* Write Code? by amrocha on Friday March 17, 2023 @07:54AM (#35195822)
I'm working on an outsourced codebase right now and boy, I wish they hadn't commented their code at all
Re:Can GPT-4 *Actually* Write Code? by hnfong on Friday March 17, 2023 @02:55AM (#35194088)
"Hey GPT-X: Can you refactor the codebase in [email protected] for me? Preferably in the style of [email protected] that I worked on last year."
Re:Can GPT-4 *Actually* Write Code? by theK on Friday March 17, 2023 @03:11AM (#35194179)
Token cap will probably be the biggest problem here.

After validation.

After getting the changes to disk, documented, actually compiling, etc…

But the biggest problem is that transferring the nuance that is external to the code base is typically really tiresome and lengthy grunt work and again token cap.

Re:Can GPT-4 *Actually* Write Code? by anonzzzies on Friday March 17, 2023 @03:19AM (#35194237)
They went from 4K to 32k in a few months. Wait a few years.
Re:Can GPT-4 *Actually* Write Code? by theK on Friday March 17, 2023 @03:34AM (#35194327)
Few years, yes. I’m with you “the change is coming” but we still need to transfer millions of tokens in and out to cater for context and out of repo intricacies.
Re:Can GPT-4 *Actually* Write Code? by anon7725 on Friday March 17, 2023 @12:31PM (#35199311)
Large enterprises will just pay to fine tune over their documents/code/etc.
Re:Can GPT-4 *Actually* Write Code? by Jensson on Friday March 17, 2023 @03:20AM (#35194245)
GPT-3 is 3 years old, not a few months.
Re:Can GPT-4 *Actually* Write Code? by anonzzzies on Friday March 17, 2023 @03:27AM (#35194291)
Sure but the token jump to 32k is new isn’t it? Even 8k to 32k is significant and that was this year.
Re:Can GPT-4 *Actually* Write Code? by Jensson on Friday March 17, 2023 @03:32AM (#35194313)
Yeah, but the jump to 32k didn't take a few months, it was years in the making. Otherwise you could extrapolate with "yesterday we had 4k, today we have 32k, tomorrow we will have 256k", that isn't how we do it. If we follow the same exponential pace 256k would have to wait 3 years, and even that is unlikely.
Re:Can GPT-4 *Actually* Write Code? by osigurdson on Friday March 17, 2023 @07:59AM (#35195878)
I think it is better to assume that we are at the beginning of the s-curve, not the end.
Re:Can GPT-4 *Actually* Write Code? by osigurdson on Friday March 17, 2023 @11:05AM (#35198008)
Wow. I never expected to be downvoted for such a comment. Downvotes please elucidate as to why we are in the asymptomatic phase with LLMs.
Re:Can GPT-4 *Actually* Write Code? by hnfong on Friday March 17, 2023 @10:48PM (#35205565)
"Luddites" refusing to accept that we might be onto something that is going to change humanity forever...

The sad thing is that real luddites would go out and actively sabotage AI development because they think it's a real threat. Yet these people just makes bold and false claims in online forums and continue to move the goalposts once they're proven wrong. Sad. Pathetic. (and obviously, I don't mind being downvoted. Whatever! :)

Re:Can GPT-4 *Actually* Write Code? by anonzzzies on Saturday March 18, 2023 @05:00AM (#35207442)
Seems very man of these here for some reason, trying to find whatever reasons and ways (gonna be licensing mostly) to spread FUD.
Re:Can GPT-4 *Actually* Write Code? by riku_iki on Friday March 17, 2023 @02:52PM (#35201282)
we don't know what that jump means, did they increased model proportionally, or slapped some projection layer with quality degradation?..
Re:Can GPT-4 *Actually* Write Code? by shinycode on Friday March 17, 2023 @03:02AM (#35194128)
Also if all the company is doing is boring crud app as a service then the whole company is going to disappear once anyone can ask ChatGPT to create a version of the service for themselves
Re:Can GPT-4 *Actually* Write Code? by Maxion on Friday March 17, 2023 @03:10AM (#35194177)
Most CRUD apps in enterprise settings relate to something in the real world. E.g. ordering systems, warehouse management and so on.

The hard part here isn’t really the coding - but understanding the business logic and getting it out of the customer what they need.

Often the customer hasn’t even got a good enough grasp on their own business to be able to formulate what they need.

In the short term this ai tools will make the programming part easier but the planning part is still hard.

Re:Can GPT-4 *Actually* Write Code? by paganel on Friday March 17, 2023 @03:22AM (#35194260)
Excellent response.

I also wanted to add about the myriad of incoming data formats that need to be processed and the myriad of data exports that one has to implement for most of those "boring" CRUD apps.

If one hasn't written code that includes comments like "Special case, California does it this way" or "Alberta needs an .xml export, not an .xsl one", with a link to a .pdf spec that points to somewhere on the internet, then he/she hasn't got to know what it really means to write a true and "boring" CRUD app.

Re:Can GPT-4 *Actually* Write Code? by Maxion on Friday March 17, 2023 @06:40AM (#35195297)
And n+1 things that HAVE to be done against the spec. Or that for some region some field has to be hidden, but only for that region - not any else.
Re:Can GPT-4 *Actually* Write Code? by spratzt on Friday March 17, 2023 @07:42AM (#35195680)
‘Understanding the business logic and getting it out of the customer’ is precisely what a lot of programmers are bad at doing. Many would rather talk to a compiler than a human being. For them, ChatGPT is a real existential threat.
Re:Can GPT-4 *Actually* Write Code? by Kostchei on Friday March 17, 2023 @11:12AM (#35198077)
Some folks grew up without practicing code- did business / operational /technical things for 20+ years. For someone like that, chatGPT is manna from heaven. 0>0>

I point chatgpt at the general problem and ask about the tech. Check it's answers, drill into specifics. As more questions, get it to write a prototype. (obviously with different parameters to prod- I don't trust open ai not to harvest from my interactions)- ok, now I have proof of concept, if it does the thing I want to do, then go to the engineers and say - hey I want to "X", here is RFC and rough code, .. any problems? if not, how long to push a localised version?

I guess you might call this scripting or prototyping not "real coding" but, damn it's useful not have to fill my head with python etc. Or bore/waste a guy earning 150k for a half day plus to get the basics, then never get my prototype.. because, priority, resources, etc