News for hackers. Stuff that matters.
Re:We promoted developers into architects without informing ... by weitendorf on Friday November 20, 2026 @04:07PM (#50582125)
I think that the more you use LLMs to work over time, the better you get at intuiting how and why the harness, training processes, or minor version changes cause these mercurial changes in performance.

And I completely agree about performance optimization btw, though I don't think I would say LLMs are better than humans at security yet because of how poor their epistemics/short their context is.

They're both highly verifiable domains that you could easily train to be superhuman because they're also easy to generate and verify against synthetic tasks. And they probably bring a lot more knowledge about software's internals in-distribution while doing it, so I don't expect to ever be able to out-optimize frontier AI at squeezing performance out of hardware or into software.

But I would be cautious to deferring to their judgment in long-horizon architecture or the more procedural, threat-modelly/incentives side of security, and for other large scale judgment calls because they simply have no experience with them.

RL is turning them into Idiot Savants so jagged in understanding and performance that they defy human expectations for what kind of knowledge and behavior correlate (causally). A human engineer superhuman at hill-climbing low level performance would be at least 95%ile at at general architecture, since they're the same problem just at larger and slower scale.

There's no good hyperbaric benchmaxxing chamber devised for tasks at this level of scope/ambiguity yet. they fall back to platitudes and best practices (the "Reddit"/HN part of the weights). In my opinion, they are just kinda "ok" at architecture. Once you're in the pocket of what they've spent more time learning in parallel than any (or all) humans could, they just let their freak flag fly without hedging or asking about it.

To demonstrate: I had Claude earlier this morning spending 3+hrs pruning a pure x86 ASM implementation of symmetric DTLS/symmetric UDP, down to a 3.8KB binary, completely from scratch. It flew off and ripped. No human alive would or will ever be able do this kind of task as quickly - expand those "66 steps" and see for yourself.

But! Any human capable of doing this task would know to add support for certificates before spending an ungodly amount of effort optimizing a security protocol implementation that needs them but doesn't have them yet! Claude has just never done anything greater in scope than 1M tokens so: https://claude.ai/share/90de9350-81f9-46ea-a628-be625e8b9a7a

Re:We promoted developers into architects without informing ... by Creamsicle47 on Friday November 20, 2026 @06:13PM (#50583706)
Who do you think a business leader will listen to, someone disagreeing with them or an omnipotent super intelligence that validates every idea of theirs?
Re:We promoted developers into architects without informing ... by weitendorf on Friday November 20, 2026 @06:27PM (#50583834)
That sounds like a false dichotomy with a bit of emotion behind it, and I'm not really sure what it has to do with long-horizon jaggedness.