Oh it gets even stupider. When Claude web introduced the "computer" stuff last year, I had it port an interpreter to a different language. It did it in one shot, I was very impressed.

It even volunteered tests.

Then I read the tests. It was just a bunch of console log statements saying "Test passed!" and didn't actually test anything...