News for hackers. Stuff that matters.
Re:LLMs Corrupt Your Documents When You Delegate by ekidd on Saturday May 09, 2026 @10:56AM (#48075481)
Where this result is actually interesting and relevant is when a coding agent splits a large source file into multiple smaller files. Opus + Claude Code will try to recite long sections of source code from memory into each of the new files, instead of using some sort of copy/paste operation like a human would.

Moving a file is a bit easier. LLMs may sometimes try to recite the file from memory. But if you tell them to use "git mv" and fix the compiler errors, they mostly will.

Ordinary editing on the other hand, generally works fine with any reasonable model and tool setup. Even Qwen3.6 27B is fine at this. And for in-place edits, you can review "git diff" for surprises.

Re:LLMs Corrupt Your Documents When You Delegate by devmor on Saturday May 09, 2026 @11:33AM (#48075785)
If you’re using LLMs for agentic work it is absolutely essential that you have a robust set of tools for them to use and the correct instructions to prompt their use.

The LLM will come up with stupid ways to do things, common sense doesn’t exist for AI.

Re:LLMs Corrupt Your Documents When You Delegate by jvuygbbkuurx on Saturday May 09, 2026 @12:04PM (#48076024)
Isn't this the whole reason they became viable in the last 6 months? The system prompt and harness is improving. It's less and less essential every day to roll your own.
Re:LLMs Corrupt Your Documents When You Delegate by embedding-shape on Saturday May 09, 2026 @12:13PM (#48076091)
I don't think there is a single reason. Models are improving, so are the harnesses, prompts and we who use them a lot also get more proficient and learn where they can be used effectively vs not, so lots of improvements all over the ecosystem, brought together.

Latest big change is probably how feasible local models are becoming, like Qwen 3.6 and Gemma 4, they're no longer easily getting stuck in loops and repetition, although on lower quantizations they still pretty much suck for agentic usage.

Re:LLMs Corrupt Your Documents When You Delegate by deadbabe on Saturday May 09, 2026 @12:55PM (#48076372)
> we who use them a lot also get more proficient and learn where they can be used effectively vs not

I think it’s always been obvious where an LLM could be used effectively and where it cannot, if you understand how they work and don’t see them as magical.

The “increase in proficiency” is mostly people coming back to reality and being more intentional about LLM usage. There are no surprise discoveries here. One does not need to use an LLM a lot to get effective with them. A total noob could become effective on day 1 with proper guidance.

Re:LLMs Corrupt Your Documents When You Delegate by ofjcihen on Saturday May 09, 2026 @03:32PM (#48077555)
I think you hit the nail on the head. I had been in this space for a little bit before it really became popular. I haven’t seen incredible gains in model competency. What I have seen though is people figuring out what works and what doesn’t.
Re:LLMs Corrupt Your Documents When You Delegate by deadbabe on Sunday May 10, 2026 @07:40AM (#48083117)
It’s pretty telling that ignoring LLMs entirely for a few years and then jumping in last minute after everyone has struggled through figuring out how to use them still puts you on the same level very quickly.
Re:LLMs Corrupt Your Documents When You Delegate by embedding-shape on Sunday May 10, 2026 @08:23AM (#48083412)
> then jumping in last minute after everyone has struggled through figuring out how to use them still puts you on the same level very quickly

Does it actually though?

I've used agents for quite some time now, if someone who never used agents before want to put this to the test somehow, I'm open to try to measure this, reach out via email :)

Re:LLMs Corrupt Your Documents When You Delegate by deadbabe on Sunday May 10, 2026 @09:10PM (#48089948)
What would you even propose as a test
Re:LLMs Corrupt Your Documents When You Delegate by embedding-shape on Tuesday May 12, 2026 @02:52PM (#48112651)
Can be anything, refactor of old thing, build new thing, change existing thing, something like "Do X in Y hours/days, then we compare the results", and we'll see if there is any differences. Do it a couple of times, you might be able to figure out how to measure it as you discover the better methodologies.
Re:LLMs Corrupt Your Documents When You Delegate by ekidd on Saturday May 09, 2026 @12:30PM (#48076189)
The models also have far more intelligence built in. For example, the pi.dev agent harness has a system prompt which fits on a single page, and includes only 4 or 5 tools. Running with a small coding model like Qwen3.6 27B, this setup is completely capable of agentic coding.
Re:LLMs Corrupt Your Documents When You Delegate by bigstrat2003 on Saturday May 09, 2026 @12:47PM (#48076311)
They still aren't viable. Nothing changed within the last 6 months.
Re:LLMs Corrupt Your Documents When You Delegate by Salgat on Saturday May 09, 2026 @02:53PM (#48077268)
My favorite is when Claude will build a completely new application to load and inspect a .dll file using reflection instead of just googling the library's interfaces.
Re:LLMs Corrupt Your Documents When You Delegate by devmor on Saturday May 09, 2026 @07:00PM (#48079111)
“Use all of the tools at your disposal, including searching the internet” is my claude-specific common instruction.
Re:LLMs Corrupt Your Documents When You Delegate by smrtinsert on Saturday May 09, 2026 @10:16PM (#48080366)
It did this for during one of the recent outrage periods. It was unjarring deps left and right instead of googling for it. What an easy way for me to own the tokenmaxxing leaderboard I remember thinking
Re:LLMs Corrupt Your Documents When You Delegate by ClikeX on Saturday May 09, 2026 @12:41PM (#48076266)
> And for in-place edits, you can review "git diff" for surprises.

I don't let AI touch git anyway, and I always review the diff after it generated stuff. If it modifies my documentation, I always want to check if it messed with the text instead of just added formatting.

Re:LLMs Corrupt Your Documents When You Delegate by isityettime on Saturday May 09, 2026 @01:23PM (#48076587)
This. I know the LLM agents often have their own little diff viewers and edit approval workflows, but for a high volume of code, I cannot imagine actually reviewing everything without leaning on much more capable Git tooling.

I use Magit, and up until I started using LLM agents it was mostly a nice-to-have that I relied on casually. (I was definitely under-utilizing its power.) But for reviewing, selectively staging, and selectively rejecting the changes of an LLM agent? I feel like I'd die without it. Idk how others manage.