Agreed theres a lot between "editing raw weights" via LLM and a bunch of code/programming. But in my case, the technique itself was new to me, and worked for a small ASR model I've been training based on moonshine + claude being able to actually reason about what was causing loops. This is something I sure couldn't/wouldn't do manually.

https://quickthoughts.ca/projects/welsh-asr/ (scroll down to the project updates to read how much impact it had)