News for hackers. Stuff that matters.
Re:Why LLM-Powered Programming Is More Mech Suit Than Artifi... by vlovich123 on Monday April 21, 2025 @11:49AM (#43753307)
And the article is overstating it as well. My confidence in the LLM's ability to reduce the "how" part is primarily based on "am I doing something the LLM is good at?". If I'm doing HTML React where there's a million examples of existing stuff, then great. The more novel what I'm asking is, the less useful the LLM becomes and the more stuff I need to handcode is. Just as with self-driving cars, this is a challenge because switching from "the LLM is generating the code" to "I'm hand-tweaking things" is equivalent to self-driving disconnecting randomly and telling you "you drive" in the middle of the highway. Oh and I've caught the LLM randomly inserting vulnerabilities for absolutely no reason (e.g. adding permissions to the iframe sandbox attribute when I complained about UI layout issues).

It's a useful tool that can accelerate certain tasks, but it has a lot of sharp edges.

Re:Why LLM-Powered Programming Is More Mech Suit Than Artifi... by bluefirebrand on Monday April 21, 2025 @12:04PM (#43753503)
> If I'm doing HTML React where there's a million examples of existing stuff, then great

I do quite a bit of this and even here LLMs seem extremely hit and miss, leaning towards the miss side more often than not

Re:Why LLM-Powered Programming Is More Mech Suit Than Artifi... by ijk on Monday April 21, 2025 @03:46PM (#43755698)
I think React is one of those areas where consistency is more important than individual decisions. With a lot of front-end webdev there's many right answers, but they're only right if they are aligned with the other design decisions. If you've ever had to edit a web page with three different approaches to laying out the CSS you know what I mean.

LLMs _can_ do consistency, they're pretty good continuing a pattern...if they can see it. Which can be hard if it's scattered around the codebase.

Re:Why LLM-Powered Programming Is More Mech Suit Than Artifi... by bluefirebrand on Monday April 21, 2025 @03:56PM (#43755791)
> one of those areas where consistency is more important than individual decisions

This describes any codebase in any programming language

This is why "programming patterns" exist as a concept

The fact that LLMs are bad at this is a pretty big mark against them

Re:Why LLM-Powered Programming Is More Mech Suit Than Artifi... by skydhash on Monday April 21, 2025 @04:51PM (#43756328)
Consistency is why frameworks and libraries exists. Once you start to see consistency in your UI views, that's a good sign to further refine it into components and eliminate boilerplate.
Re:Why LLM-Powered Programming Is More Mech Suit Than Artifi... by namaria on Monday April 21, 2025 @03:57PM (#43755805)
> LLMs _can_ do consistency

They won't even consistently provide the same answer to the same input. Occasional consistency is inconsistency.

Re:Why LLM-Powered Programming Is More Mech Suit Than Artifi... by bcrosby95 on Monday April 21, 2025 @04:38PM (#43756214)
My favorite is when I ask it to fix a bug, and in the part of the code that doesn't change it still slightly rewords a comment.
Re:Why LLM-Powered Programming Is More Mech Suit Than Artifi... by snovv_crash on Monday April 21, 2025 @01:13PM (#43754177)
> Oh and I've caught the LLM randomly inserting vulnerabilities for absolutely no reason (e.g. adding permissions to the iframe sandbox attribute when I complained about UI layout issues).

Yeah, now get the LLM to write C++ for a public facing service, what could possibly go wrong?

Re:Why LLM-Powered Programming Is More Mech Suit Than Artifi... by elevaet on Monday April 21, 2025 @07:45PM (#43757679)
This is the real reason why it's an amplifier and not a replacer.
Re:Why LLM-Powered Programming Is More Mech Suit Than Artifi... by UltraSane on Tuesday April 22, 2025 @02:13PM (#43764824)
LLMs are MUCH better generating Python or SQL than APL.