News for hackers. Stuff that matters.
Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by visarga on Monday October 09, 2023 @03:06PM (#37824009)
The cold water bucket that needs to fall on people who fear monger job automation. These models are stumbling in a few steps. Nobody can go on vacation and leave AI do their job. What we can automate - is maybe 2-3 turns until it gets stuck - should be thousands of steps for real automation. It's almost 0% autonomy right now, how do we go from 0% to 1%?
Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by zemvpferreira on Monday October 09, 2023 @03:27PM (#37824300)
I don't think I'm a fear mongerer but the amount of reasonably qualified jobs that can be displaced by the models we have now seems huge. In the hands of a qualified human AI-manager they are incredibly productive when the output doesn't have to be cutting edge.

I know people who have already automated most of their own job and some colleagues through linking together disparate AI models. Think graphic designer at medium-sized law firm. Or copywriter at a scientific publisher. Those jobs are going, going, gone.

Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by swatcoder on Monday October 09, 2023 @03:45PM (#37824575)
If you think about this generation of text/media AI as being a kind of generalized decrompressor for some input prompt, the output has more detail than the input but never more information.

So as any model becomes widespread, people will become increasingly sensitive to the sameness of easy, simple prompts.

So the graphic designer at the law firm may lose their job tomorrow, but the law firm is going to have to hire a AI Image Technician in a few years so that their stuff looks like somebody actually invested in it (which matters to the law firm’s brand image or they’d not have a graphic designer in the first place).

So yeah, the job market will shuffle around, but it’s unclear what that means in net number of jobs or what share of AI Image Technicians will literally have just been Graphic Designers five years earlier.

Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by dimgl on Monday October 09, 2023 @03:49PM (#37824622)
> I don't think I'm a fear mongerer but the amount of reasonably qualified jobs that can be displaced by the models we have now seems huge.

Maybe I'm living under a rock, but I have serious doubts about this claim.

> Think graphic designer at medium-sized law firm. Or copywriter at a scientific publisher.

How is that even possible? Take the example of the graphic designer. You'd still need them to iterate on ideas, come up with different versions for different backgrounds, generate different file types depending on the medium and format, etc. Extremely skeptical of your claims.

Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by zemvpferreira on Monday October 09, 2023 @05:37PM (#37825837)
That's the thing, a lot of professionals do rote jobs that are necessary but not valued by their employers - such as designers at law firms. Many law firms, I believe, will settle for an AI-generated version of their old logo/masthead/website and fire their designer.
Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by astrange on Monday October 09, 2023 @03:53PM (#37824677)
Making someone's job more productive makes them more valuable in that job, not less.
Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by bondarchuk on Monday October 09, 2023 @03:59PM (#37824747)
There used to be 2 garbagemen on every garbage truck in my city, now they have a remote-controlled crane which is operated by a single garbageman who also drives the truck and presumably they fired the other. Garbageman 2x productive > 2x fewer garbagemen. This is a concrete example that contradicts your claim.
Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by astrange on Monday October 09, 2023 @04:20PM (#37825001)
Or they didn't fire them and they're doing another task in the same job. Or they're on another route and they run more garbage trucks than they used to, since population has grown.
Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by hewlett on Monday October 09, 2023 @04:59PM (#37825414)
I doubt they were fired. sanitation workers have pretty strong unions
Re:LLMs can't self-correct in reasoning tasks, DeepMind stud... by emporas on Monday October 09, 2023 @04:05PM (#37824810)
"These models are good in automating tasks, not workflows or jobs." Sam Altman on Joe Rogan.

Think about the scenario of a home, in case the homeowner is going on a vacation:

i) The homeowner talks to an A.I. assistant, and orders the agent, to open the windows every day automatically, and feed the dog. The A.I. agent may hallucinate, and do none of the tasks.

ii) The homeowner with the help of the A.I. assistant, will write a small program, to open the windows in the exact time he wishes, and with the right interval of hours, and feed the dog exactly that many times. That program will run correctly and deterministically till the end of the universe.

Complicated programming is not getting automated any time soon, maybe never. Simple programming tasks are going to be automated by humans, who lack formal C.S. training and use the statistical engines to complete some not so obvious tasks to them.