News for hackers. Stuff that matters.
Re:Kids who use ChatGPT as a study assistant do worse on tests by ffsm8 on Thursday September 05, 2024 @02:39AM (#41454164)
> Current research is that experts are better with a ChatGTP, and beginners worse.

Current research being your opinion?

Because literally every expert I personally know to be competent says that they're essentially garbage producers and don't use them beyond occasionally checking if they've improved. And no, they haven't.

The only way to get decent code from them is to be so specific that you'd be able to produce the same code in a fraction of the time you need to add all the context necessary for the LLM to figure it out.

It's like coding with a junior. Thay can produce great code too. It's just gonna take a lot of handholding if complexity skyrocks.

The only place llms got a foot hold is with generating stock art that's mostly soulless marketing material. This "industry" is going to crash so hard in the next 3 years

Re:Kids who use ChatGPT as a study assistant do worse on tests by wisty on Thursday September 05, 2024 @03:29AM (#41454393)
Sorry, it was from a comment, metrics showed senior devs improved, juniors didn't.

But if you want a sketch solution quickly, know the requirements, and can fix the silly mistakes it's a useful tool. Especially if you are doing something where you are rusty, or are used to a slightly different framework or language.

They are like a super fast but slightly clueless junior, who can hammer out mostly correct boilerplate. Not someone you want unsupervised or training a junior, but usefully in some ways.

And yes, boilerplate has disadvantages, but it has its place.

Re:Kids who use ChatGPT as a study assistant do worse on tests by john_the_writer on Thursday September 05, 2024 @03:01AM (#41454260)
Agreed.. All the co-pilot devs where I work are the juniors. Most of us just type the code we want.
Re:Kids who use ChatGPT as a study assistant do worse on tests by wisty on Thursday September 05, 2024 @03:41AM (#41454464)
Experts are often slower at starting to learn new tricks, because they don't need them, but are better at using them once they do.

But for junior devs, it's often the blind leading the blind.

That said, I don't actually use ChatGTP much. I'm just pretty sure I should in some areas.

Re:Kids who use ChatGPT as a study assistant do worse on tests by orwin on Thursday September 05, 2024 @09:09AM (#41456282)
Not a junior, but I find it useful.

Generating test data, adding documentation template for functions (which tbh is less useful when you specify types everywhere, even inferred types) and recently, after reading a HN comment, 'rubber ducking'. Which is great, because almost each time I need the rubber duck technique was for real obvious and easy issues I overcomplicated (last was induced by a naming change), and ChatGPT is quite good at that.

Re:Kids who use ChatGPT as a study assistant do worse on tests by 2muchcoffeeman on Thursday September 05, 2024 @05:19AM (#41454947)
>The only way to get decent code from them is to be so specific that you'd be able to produce the same code in a fraction of the time you need to add all the context necessary for the LLM to figure it out.

You’re not using it to be better than yourself though in your domain of expertise though.

For example if I need a very specific bash script, I can describe it to ChatGPT and get a good result far faster than I can learn the appropriate bash.

Or if I need a summary of all the config options for some package.

You can also use it to speed up your own learning. But this all depends on you being able to check the out put.

Re:Kids who use ChatGPT as a study assistant do worse on tests by aabbcc1241 on Thursday September 05, 2024 @02:08PM (#41459079)
seems it's more about active thinking vs just get the job done mindset