News for hackers. Stuff that matters.
Re:Teaching Large Language Models to Self-Debug by matisseverduyn on Wednesday April 12, 2023 @04:56PM (#35546772)
Useful, but still wouldn't count on it.

With respect to GPT etc. as a copilot, the current dialogue seems to focus on "ask for GPT to generate code to do X" then "just paste in the error message to fix bugs in the code GPT generates"

A.) Why is GPT generating code that results in simple compiler errors (that is why GPT probably shouldn't be used to generate any code / replace devs for real projects yet), and

B.) error messages are (just guessing here) probably <1% of the actual errors in most codebases.

I personally know of a few large companies laying off devs over this.

IMO, the tech debt we're going to see in 6 months will probably be huge. Good now to start a staffing agency of human experts who can come in and fix this type of problem (extricating massive amounts of code generated by GPT without starting from scratch) because there will be a bunch of fires to put out and those fires will be worth $

Re:Teaching Large Language Models to Self-Debug by david2ndaccount on Wednesday April 12, 2023 @05:09PM (#35546966)
> I personally know of a few large companies laying off devs over this.

They’re laying people off and replacing them with chat gpt generating code? That seems... aggressive. Or are they laying off devs who copy-pasted gpt-generate code?

Re:Teaching Large Language Models to Self-Debug by matisseverduyn on Wednesday April 12, 2023 @05:11PM (#35546986)
Replacing devs with LLMs.
Re:Teaching Large Language Models to Self-Debug by blondin on Wednesday April 12, 2023 @05:18PM (#35547108)
color me skeptical. what are those large companies that are replacing devs with LLMs?
Re:Teaching Large Language Models to Self-Debug by broast on Wednesday April 12, 2023 @05:32PM (#35547264)
I think it's more natural than you might think. For example, my company laid off a lot of people to try to be profitable, and now they pay me more but I have a smaller team with tighter deadlines. I have no choice but to use gpt for a lot of my analysis, design, and code- which I've gotten pretty used to over the past year in my hobby time

The way I see it, if you code without it, you won't compete with the speed and value.

And they are not going to back fill those roles

Re:Teaching Large Language Models to Self-Debug by qumpis on Wednesday April 12, 2023 @08:34PM (#35549220)
Can you give some of your usecases? Is it involved stuff or mostly boilerplate? Curious how a team lead uses this tech.
Re:Teaching Large Language Models to Self-Debug by runlaszlorun on Wednesday April 12, 2023 @09:48PM (#35549799)
I’m not knocking the parent post here for not replying. But of the 4 or so times on HN that I’ve seen someone been asked to provide detail, I haven’t seen a single answer. I’m not on here a ton but do people tend not to check back?

I’ll admit my bias of having seen enough vacuous industry hype over the years to be naturally skeptical. Heck, I worked in a marketing department once where I helped manufacture the stuff (forgive me father for I have sinned, in my defense they did fire me after three months in a layoff). But my few personal experiences with ChatGPT were pretty disappointing and I’m actually looking for someone to tell me otherwise.

Re:Teaching Large Language Models to Self-Debug by qumpis on Thursday April 13, 2023 @05:29AM (#35553015)
Yes I think since it requires to look up your own comments to see if you got any replies, it's quite common to not get any replies, and I'm very guilty of this myself.

My personal use of gpt4 (also daily) is: correct, rephrase spelling from my brain dump, make python plots (stylize, convert, add subplots, labels, handle indexing when things get inverted), makw short shell scripts (generated 2FA, login vpn through console using 2fa, make script of disabling keyboard etc), and help debug my code (my situation is this, here's some code, what do you suggest?).

The last part is an interesting one for people with attention deficiency disorders, like myself, where procrastination can be conquered when there's an assistant that keeps you on track.

Re:Teaching Large Language Models to Self-Debug by runlaszlorun on Thursday April 13, 2023 @03:25PM (#35560840)
> The last part is an interesting one for people with attention deficiency disorders, like myself, where procrastination can be conquered when there's an assistant that keeps you on track.

Aha, I’ll def have to give it a whirl. My procrastination ability is world class.

Re:Teaching Large Language Models to Self-Debug by ratg13 on Wednesday April 12, 2023 @06:05PM (#35547668)
You can’t replace devs with LLMs because someone that knows what they are doing still needs to put it all together.

You can only make employees more productive.. this in turn could, in theory, lessen the need for developers in the long run, but it assumes the company will not bother to use the extra bandwidth for other projects.

Re:Teaching Large Language Models to Self-Debug by highduc on Wednesday April 12, 2023 @09:37PM (#35549718)
I also believe the gain is in productivity more than needing less people. They will fire as much as possible, but the largest gains seem to me to be in productivity.
Re:Teaching Large Language Models to Self-Debug by sublinear on Wednesday April 12, 2023 @11:35PM (#35550603)
> use the extra bandwidth for other projects.

This is exactly what would happen if ChatGPT was actually a productivity boost for senior devs. I don't know why some idiots on here keep insisting businesses want to get rid of people when that's not how the game works at all. Extra work capacity will always be used. Regardless of what payroll costs, what's always more important is the ROI.

Re:Teaching Large Language Models to Self-Debug by sdfghswe on Wednesday April 12, 2023 @05:50PM (#35547500)
My company recently hired someone that I'm absolutely convinced can't code and produces all their code by copy pasting into/from ChatGPT. I absolutely think they should be fired, it's not even aggressive, it's just common sense. First that means they cheated on their coding interview. Second it means their code is consistently a pile of shit.
Re:Teaching Large Language Models to Self-Debug by viscanti on Wednesday April 12, 2023 @05:05PM (#35546912)
If an LLM hallucinates lines of code that can't even compile, I suppose it could also hallucinate logic issues which are more difficult to track down.
Re:Teaching Large Language Models to Self-Debug by matisseverduyn on Wednesday April 12, 2023 @05:08PM (#35546948)
Definitely. QA at a snails pace should still be the focus here for a while, but that's not what I'm observing in the real world. Just rush, pressure, layoffs. At least this sort of behavior keeps humans employed long-term.
Re:Teaching Large Language Models to Self-Debug by runlaszlorun on Wednesday April 12, 2023 @09:36PM (#35549704)
I have limited experience even trying. But I did try it for some fundamental JS Web API stuff sans framework or library like IndexedDB, web sockets, and a basic, basic todo like app.

Neither of those three would function nor would they throw an error. Prompts to correct itself would not improve things.

So I did the natural thing and started to debug myself. At which point, I couldn’t help but ask myself why I was debugging machine generated code when I could not be lazy and actually build it from first principles.

Re:Teaching Large Language Models to Self-Debug by sublinear on Wednesday April 12, 2023 @11:30PM (#35550557)
> IMO, the tech debt we're going to see in 6 months will probably be huge. Good now to start a staffing agency of human experts who can come in and fix this type of problem (extricating massive amounts of code generated by GPT without starting from scratch) because there will be a bunch of fires to put out and those fires will be worth $

Nah they deserve to eat shit and the staffing agencies hired to fix the bad AI code will undoubtedly be people abroad who barely speak English and will only tangle it up worse. I would actually pay to be a fly on the wall in those meetings listening to people lose their minds in frustration.