News for hackers. Stuff that matters.
Re:Meta's new LLM-based test generator is a sneak peek to th... by superb_dev on Friday February 23, 2024 @06:44PM (#39487593)
What exactly are we testing at that point?
Re:Meta's new LLM-based test generator is a sneak peek to th... by Groxx on Friday February 23, 2024 @07:04PM (#39487764)
Ensuring that `if x == 1` works when x == 1.

Very important. Very valuable.

Imagine if `if err != nil { return err }` just stopped working tomorrow. Your tests would detect it! Outage prevented!

Re:Meta's new LLM-based test generator is a sneak peek to th... by Cthulhu_ on Friday February 23, 2024 @07:14PM (#39487818)
You're being sarcastic but honestly, I've never found a regression because of a unit test.

Only past few days though, I did find two bugs that would've been prevented if the original code was covered by a decent unit test.

Re:Meta's new LLM-based test generator is a sneak peek to th... by sangnoir on Friday February 23, 2024 @10:20PM (#39488854)
> You're being sarcastic but honestly, I've never found a regression because of a unit test

So you've never made a change caused a unit test to fail? If not, how large is your codebase, and is ownership shared across multiple teams?

I caught dozens of latent or unreported bugs by writing unit tests for a 6kloc JS app which had 0% coverage before.

Re:Meta's new LLM-based test generator is a sneak peek to th... by cgdub on Friday February 23, 2024 @07:25PM (#39487879)
I don't write Perl or Ruby anymore, but this would have been immensely helpful back then.