News for hackers. Stuff that matters.
Re:LLMs are eroding my software engineering career and I don... by ofjcihen on Sunday June 07, 2026 @01:12PM (#48436771)
This is akin to “don’t make mistakes”

“Verify all facts and compliance requirements” leaves enormous holes even if you assume the LLM has a concept of facts and requirements (it does not).

What facts? What requirements? For what industry? For what subset of that industry? For what country or countries that you will be doing business in? Are these current “facts” and “requirements” or is the LLM referencing a dusty article from 1992 for which the subject matter has been radically overhauled?

In my job I regularly see small but incredibly important mistakes like this lead to major issues. Some of those are human driven but increasingly the defense of the person responsible has turned into “Claude said it was fine though!”

Re:LLMs are eroding my software engineering career and I don... by kolinko on Sunday June 07, 2026 @02:54PM (#48437567)
Well, you wouldn't just give human a task "verify all facts and compliance requirements" and expect it to end well either, no?
Re:LLMs are eroding my software engineering career and I don... by ofjcihen on Sunday June 07, 2026 @04:33PM (#48438265)
If I was working with someone who had experience in the specific industry then yes, that is in fact what I would do.

If I plucked a random passerby and gave them the task then no, I’d find myself detailing out every specific to them.

You’re equating the LLM to the least qualified candidates. I don’t think your argument is communicating what you intended.

Re:LLMs are eroding my software engineering career and I don... by zuzululu on Sunday June 07, 2026 @05:51PM (#48438940)
of course not, nobody experienced at their job would/should be saying that and expecting it to be flawlessly followed through especially cybersecurity.

feel like the parent you are replying to literally views their place of work as a daycare which is very condescending

Re:LLMs are eroding my software engineering career and I don... by ofjcihen on Sunday June 07, 2026 @06:33PM (#48439269)
You’ve managed to contradict yourself between your 1st and 2nd sentence. I’m not sure what point you’re trying to make.

The argument is regarding LLMs and domain knowledge.

Re:LLMs are eroding my software engineering career and I don... by zuzululu on Sunday June 07, 2026 @06:42PM (#48439355)
Explain.
Re:LLMs are eroding my software engineering career and I don... by ilaksh on Sunday June 07, 2026 @01:24PM (#48436878)
It can make mistakes and will sometimes, but what he specifically mentioned was a case where it did not pull up a reference that it needed. So using a web search tool effectively would make a big difference.
Re:LLMs are eroding my software engineering career and I don... by ofjcihen on Sunday June 07, 2026 @01:34PM (#48436969)
It still does not rise the standard he requires which your response indicated would be easy for the model to achieve with a simple prompt.

Additionally, using a specific tool does not suddenly give the model common sense enough to say “this piece of information doesn’t answer the question of whether this solution fits in this specific industry at this time in this place”.

Re:LLMs are eroding my software engineering career and I don... by ilaksh on Sunday June 07, 2026 @02:08PM (#48437232)
A web search tool to pull up the law that is relevant?
Re:LLMs are eroding my software engineering career and I don... by rfgplk on Sunday June 07, 2026 @06:51PM (#48439443)
> “Verify all facts and compliance requirements”

No. This is a disasterous instruction. Not only is it vague, but it's also meaningless. When giving instructions to an LLM your prompt must be concise and exact. Tell it _exactly_ which requirements need to be followed, ideally have it write or (preferably) pass audited tests to enforce these requirements. You also need to provide it with a hard source of truth it can rely upon. Instead of saying "verify facts", you're better off by saying "... make sure [whatever you're doing] matches with data at X.Y.Z, verify by running [instruction/command/program]"

Re:LLMs are eroding my software engineering career and I don... by zuzululu on Monday June 08, 2026 @02:14AM (#48441849)
Especially in cybersecurity.
Re:LLMs are eroding my software engineering career and I don... by ofjcihen on Monday June 08, 2026 @08:34AM (#48444541)
I think you might have meant to reply to the parent comment.
Re:LLMs are eroding my software engineering career and I don... by zuzululu on Monday June 08, 2026 @02:20AM (#48441881)
If someone can’t distinguish between the two then I honestly wonder what company would be comfortable putting them anywhere near a regulated or security-sensitive workflow especially from someone one that condescendingly views their own jobs as a daycare for people seemingly beneath them.