AI is not Making Engineers 10x as Productive

Re:AI is not Making Engineers 10x as Productive by leptons on Tuesday August 05, 2025 @02:39PM (#44802342)

So what happens when someone calls in and the "AI" answers (because the receptionist has been fired and replaced by "AI"), and the caller asks to access some company record that should be private? Will the LLM always deny the request? Hint: no, not always.

There are so many flaws in your plan, I have no doubt that "AI" will ruin some companies that try to replace humans with a "tin can". LLMs are being inserted loosey-goosey into too many places by people that don't really understand the liability problems it creates. Because the LLM doesn't think, it doesn't have a job to protect, it doesn't have a family to feed. It can be gamed. It simply won't care.

The flaws in "AI" are already pretty obvious to anyone paying attention. It will only get more obvious the more LLMs get pushed into places they really do not belong.

[ Parent | on HN ]

Re:AI is not Making Engineers 10x as Productive by vanviegen on Wednesday August 06, 2025 @02:44AM (#44808514)

> Will the LLM always deny the request? Hint: no, not always.

And you are confident that the human receptionist will never fall for social engineering?

I don't think data protection is even close to the biggest problem with replacing all/most employees with bots.

[ Parent | on HN ]

Re:AI is not Making Engineers 10x as Productive by leptons on Wednesday August 06, 2025 @12:48PM (#44814476)

The human receptionist can use critical thinking, and self preservation to prevent a bad outcome. The LLM can not. When a person causes a problem, they can be fired, and learn from the event. The LLM will not learn from it. And who is responsible then? The company providing the LLM? The more LLM use becomes pervasive, the taller the house of cards gets.

[ Parent | on HN ]