I’ve never seen Claude do that. It makes the new tests pass by fixing previously unknown bugs in my experience.

I love Claude but on several occasions I've had it do some really funky stuff just to get tests passing

I had it do it about a month ago. It changed test data which caused another test to fail and instead of isolating things it decided to flip an assert.

That's because Opus needed vacation and they routed your requests to its less sophisticated cousin, Claude Dynamite. ;)

You have to keep an eye on them, but they don't just make tests pass.

Claude sonnet 4 (this time last year) did do this. It once made simulation if a test script passing. Literally a script that just echoed test names and then said pass.

Change happens fast, a year old model is pretty outdated.

I'm sure it can happen, hence why I said to keep an eye out. Its main mode of operation is not to cook the tests however.

Happened to me, 3 days ago - deleted some tests and flipped assertions after outlining that it wasn't to change any assertions.

Our team was doing a similar task to move between test frameworks, and I had to do a git diff of hundreds of thousands of lines to try and work out where a test had disappeared to.

> 3 days ago

Your fault. You should have used a model from 0.000005 seconds ago!

Reading is difficult.

Not that difficult. You should try it sometimes!

Try to put in a little more effort next time. It makes for better discussions instead of "jokes" that aren't even relevant.

I discuss with civilised people who are up for civilised discussions.

You are the one ruining this discussion, it's worrying that you don't even realize it. I pointed out that models change quite a bit over time (I said more than that) and you ridicule my reply. "Your fault. You should have used a model from 0.000005 seconds ago!"

Civilised. Please.

Imagine not realizing that was a joke.

Imagine that, after I specifically called it a "joke". Result.. An irrelevant low quality meta discussion.

> Change happens fast, a year old model is pretty outdated.

What change? That you should not fake the results of a test because that defeats the whole purpose of a test has been known before there were computers.

I don't know, the weather?

Yeah, in 2024.