Meta's new LLM-based test generator is a sneak peek to the future of development

Re:Meta's new LLM-based test generator is a sneak peek to th... by ralusek on Friday February 23, 2024 @08:17PM (#39488213)

I basically agree with this but some caveats. I often find there are maybe 5% of the tests I should write that only I could write, because they deal with the specifics of the application that actually give it its primary purpose/defining features. As in, it's not that there is any test I believe AI eventually wouldn't be able to write, it's more that there are certain tests that define the "keyframes" of the application, that without defining explicitly, you'd be failing to describe your application properly.

For the remaining 95% of uninteresting surfaces I'd be perfectly happy to let an AI interpolate between my key cases and write the tests that I was mostly not going to bother writing anyway.

[ Parent | on HN ]

Re:Meta's new LLM-based test generator is a sneak peek to th... by ajmurmann on Friday February 23, 2024 @08:21PM (#39488240)

You are probably right and the percentages change with the language and framework being used. When I write Ruby I write enormous amounts of tests and many of these could probably be derived from the higher-level integration tests I stared with. In Rust on the other hand, I write very few tests. I wonder if this also shows which code could be entirely generated based on the high-level tests.

[ Parent | on HN ]