News for hackers. Stuff that matters.
Re:Harvard researchers find AI coding agents shifted the bot... by tietjens on Wednesday November 18, 2026 @05:24AM (#50544425)
If you're willing to share I'd be curious to know which domain and languages you're working in. Out of curiosity to know where people's results might not match OPs here.
Re:Harvard researchers find AI coding agents shifted the bot... by soulofmischief on Wednesday November 18, 2026 @06:14AM (#50544849)
Generally anything where architecture and interfaces matter, such as performance or security sensitive work, which is quite a wide variety of things. I also just know how I want things to be, and have trouble with adherence. Models will tell you they adhere to your specification and acceptance criteria all day, but if you review the code closely, it's often a horror show. Well-designed interfaces can act as boundaries to the chaos, but even getting those interfaces right is sometimes extremely frustrating.

Another good example is working with libraries which require a specific modality of thought or design philosophy, such as an ECS system. Frontier models still are horrible at writing efficient game code using modern ECS principles, no matter how much reference documentation or guidance I give them. They shove OO into places it doesn't belong, misunderstand the concept of SoAs, or find ways to destroy any gains made in one place by making horrible decisions in another place.

I will point them to exact codebases I've written in pre-AI days, say "do it exactly this way" and still find that the models often insert their own biases and misconceptions and motivations all over the work. They sometimes flat out ignore instructions or lie / producing convoluted code that pretends to do something else, in order to preserve something it liked, even if I expressly wanted it gone (Current GPTs are extremely stubborn and defensive / passive aggressive and sometimes have trouble with authority). I frequently find myself being gaslit, lied to by omission, have serious security or performance concerns heavily downplayed, etc.

I withhold from making assumptions about OP's skill, but I have confidence in my own. I have worked both extensively as an engineer and CTO leading teams of other engineers, and I am a stickler for quality code and thoughtful design. I advise and mentor other engineers. So it might really just be a skill gap, domain difference or something more nefarious, such as A/B testing of models. I already have experienced clear sudden model degradation multiple times, so it's entirely possible this is what is happening. All I know is that the currently available frontier models do not design or code as well as me.

Re:Harvard researchers find AI coding agents shifted the bot... by fireflash38 on Wednesday November 18, 2026 @06:58AM (#50545217)
Claude writing python sucks. Anti patterns everywhere. It loves to pass around closures and function objects as parameters so good luck reading it later.