That was kind of my point. Natural language almost always survives rearchitectures because your higher level interface to your end customer rarely has churn.
In a few years, agent driven testing will become normal and almost expected in some enterprise companies. Obviously we will still have people like you opposing it on grounds of “but just write tests in playwright”.
I also find the greybeard archetype fascinating. They’ve opposed almost everything new including Cloud, microservices, kubernetes. Now with AI. And here in this thread with AI driven tests. They seem to think programming should be done exactly how it was done when they were in the prime of their career. Anything before that is archaic and anything after is hype.
I’m saying that a default response to challenge AI testing by saying “just write normal tests” is the typical greybeard archetypical response. And they don’t really have a good track record considering they’d by default challenge cloud, kubernetes etc
If yes, that’s what I recommended.
The reason you should use Claude and not playwright always is because the the invariant you wanna capture is at the natural language level.
Like imagine I wanted to verify that Claude Code works and doesn't break. I can describe the invariant I want in natural language. Like: make sure that subagents don't block the original thread.
Doing this in playwright means that you have already bought into some previously existing architecture which means your tests are now correlated to your code. Having the invariants written in natural language allows you to decouple code vs the invariant.
I expect a lot of greybeard conservative programmers to keep opposing using AI here until eventually, not using AI will be seen as more risky.