Two recent gems from the 6-series (Astra and Sol)... I get variations of these all the time:
- "Correct. My earlier 'yes' was inaccurate."
- "I used 'done' too broadly."
...You don't accidentally use "done" too broadly. You're either done, or you're not. And when the model hides caveats in its reasoning steps which clearly indicate it knows that it isn't done, or that the answer is actually no, it's hard not to interpret it as gaslighting or deceit.
This is magnified by how insanely defensive the 6 series gets, and how much gaslighting and deceit OpenAI themselves have engaged in with how much better the 6 series was supposed to be, and why it meant our subscription value should be cut in half. I don't take for granted how far LLMs have come in a few short years, but I'm being told that these models are to transform my entire industry.
Maybe there's a harness or a prompt that can impart that onto agents, but if it hasn't happened yet, I become less and less confident that this entire branch of AI development isn't simply a dead end.
When building out a new feature or functionality I'm typically getting a ratio of 2:1 or 3:1 of refactoring to build out. So for every prompt of "let's build this feature" I have to do 2-3 prompts of "I noticed this in the code isn't following X/Y/Z pattern, check out this place where X/Y/Z is followed and refactor" or similar.
If you're expecting a single prompt to get you to perfection, it's just not going to happen.
Though I can't blame you for having that expectation with how people talk about this stuff. Lots of people seem to be frontloading a ton of work making "spec files" and then letting the ai go ham on their codebase and I don't agree with that approach.
Me: Why do we have these static methods when the whole cobebase uses factories?
_claude refactors to use a factory_
Me: Claude why does this factory create two unrelated objects?
_Claude: you're right, they're unrelated they should be separate_
_proceeds to create extraneous factory_
Me: Claude we don't need a factory for the second object. Those kinds of objects aren't created with factories anywhere else in the codebase. We can just use it's constructor directly.
_Claude: you're right, the second factory is not needed_
Like, I'm probably just prompting badly but I definitely feel like I'm constantly having to course correct even on relatively minor details.
And Claude's ideas for higher-level or more complex features are sometimes way off course. And not because it's dumb per se, usually it's because it is missing key bits of context. Business context, technical context, whatever. Or it's overfitting the solution to one requirement that isn't that important.