Re:We created the first open source implementation of Meta's...
by dkdbejwi383 on Tuesday May 21, 2024 @10:34AM
(#40429017)
> Beyonce rule and all that
If you fixed it then you should have put a test on it?
Re:We created the first open source implementation of Meta's...
by Swizec on Tuesday May 21, 2024 @11:14AM
(#40429528)
Yes. The problem with automatically deriving tests from your implementation is that you’re no longer testing your intent, just your implementation. Your tests and your code will have the same bugs dutifully recorded in 2 places.
Your Beyonce rule no longer means “I meant to do that” it now means “I wrote what I wrote”
LLM generated tests are the ultimate response to “Our CTO wants high test coverage but we all know it’s bullshit and provides little to no value”. They exist to tick a checkbox.
Maybe there’s a little value in using these as regression tests. Beyonce rule and all that. Kinda like double entry accounting. “Oh the code makes the same mistake in 2 places, that must mean it’s on purpose”