News for hackers. Stuff that matters.
Re:We promoted developers into architects without informing ... by bikeshaving on Friday November 20, 2026 @02:21PM (#50580376)
I’ve found that the “job” of using AI is mainly foible management. What the author describes here is a habit of coding agents to excessively use and create logging infrastructure, and sloppily leave it in production code even when unnecessary. For instance, I created an IPA IME keyboard (https://ipabet.org/), and I found in review that Claude would leave the debugging tooling around unflagged, which essentially made the program a key-logger.

These foibles come and go: early Claude Code refused to let programs crash, mangled all the comments in your codebase, and then one week you find that it insists on ending all functions with `Of` as in `layoutOf()`, `viewOf()`. Finding and mitigating these annoying habits becomes part of the job. Code review becomes articulating with this entity why certain patterns in the code are silly and should be changed.

The author mentions performance and security issues as the domain of “the architect.” For performance, I’ve found that Claude Code has more or less solved this domain, and can profile and optimize code across a variety of stacks and languages using sophisticated, ad-hoc workflows. For security, it’s just an ever-ending nightmare where random habits and sloppy implementation create random vulernabilities, compounded by the fact that Anthropic has added “safeguard filters” whenever you naively say you’re looking for them. Nevertheless, I’m not sure the architecting role as they describe won’t be automated in the near future.

Re:We promoted developers into architects without informing ... by hinkley on Friday November 20, 2026 @02:39PM (#50580701)
[delayed]
Re:We promoted developers into architects without informing ... by weitendorf on Friday November 20, 2026 @04:07PM (#50582125)
I think that the more you use LLMs to work over time, the better you get at intuiting how and why the harness, training processes, or minor version changes cause these mercurial changes in performance.

And I completely agree about performance optimization btw, though I don't think I would say LLMs are better than humans at security yet because of how poor their epistemics/short their context is.

They're both highly verifiable domains that you could easily train to be superhuman because they're also easy to generate and verify against synthetic tasks. And they probably bring a lot more knowledge about software's internals in-distribution while doing it, so I don't expect to ever be able to out-optimize frontier AI at squeezing performance out of hardware or into software.

But I would be cautious to deferring to their judgment in long-horizon architecture or the more procedural, threat-modelly/incentives side of security, and for other large scale judgment calls because they simply have no experience with them.

RL is turning them into Idiot Savants so jagged in understanding and performance that they defy human expectations for what kind of knowledge and behavior correlate (causally). A human engineer superhuman at hill-climbing low level performance would be at least 95%ile at at general architecture, since they're the same problem just at larger and slower scale.

There's no good hyperbaric benchmaxxing chamber devised for tasks at this level of scope/ambiguity yet. they fall back to platitudes and best practices (the "Reddit"/HN part of the weights). In my opinion, they are just kinda "ok" at architecture. Once you're in the pocket of what they've spent more time learning in parallel than any (or all) humans could, they just let their freak flag fly without hedging or asking about it.

To demonstrate: I had Claude earlier this morning spending 3+hrs pruning a pure x86 ASM implementation of symmetric DTLS/symmetric UDP, down to a 3.8KB binary, completely from scratch. It flew off and ripped. No human alive would or will ever be able do this kind of task as quickly - expand those "66 steps" and see for yourself.

But! Any human capable of doing this task would know to add support for certificates before spending an ungodly amount of effort optimizing a security protocol implementation that needs them but doesn't have them yet! Claude has just never done anything greater in scope than 1M tokens so: https://claude.ai/share/90de9350-81f9-46ea-a628-be625e8b9a7a

Re:We promoted developers into architects without informing ... by Creamsicle47 on Friday November 20, 2026 @06:13PM (#50583706)
Who do you think a business leader will listen to, someone disagreeing with them or an omnipotent super intelligence that validates every idea of theirs?
Re:We promoted developers into architects without informing ... by weitendorf on Friday November 20, 2026 @06:27PM (#50583834)
That sounds like a false dichotomy with a bit of emotion behind it, and I'm not really sure what it has to do with long-horizon jaggedness.
Re:We promoted developers into architects without informing ... by ricardobeat on Friday November 20, 2026 @06:47PM (#50584028)
> I created an IPA IME keyboard

> and I found in review that Claude would leave the debugging tooling around unflagged

Why is Claude to blame for that particular decision, if you created it? That's what this is about - you need to constrain the design space to take responsibility. In this case, understand the debug tooling and what it should be doing. Negative prompting is rarely a good solution.