News for hackers. Stuff that matters.
Re:The Coming Knowledge-Work Supply-Chain Crisis by djoldman on Monday April 28, 2025 @06:14AM (#43819548)
This. Tests are important and they're about to become overwhelmingly important.

The ability to formalize and specify the desired functionality and output will become the essential job of the programmer.

Re:The Coming Knowledge-Work Supply-Chain Crisis by sn9 on Monday April 28, 2025 @08:40AM (#43820853)
I'm shocked how many people haven't yet realized how important formal methods are about to be.

If you can formally specify what you need and prove that an LLM has produced something that meets the spec, that's a much higher level of confidence than hoping you have complete test coverage (possibly from LLM generated tests).

Re:The Coming Knowledge-Work Supply-Chain Crisis by vacuity on Monday April 28, 2025 @11:16AM (#43822422)
There is a critical distinction between tests and formal specification/verification. It is not sufficient to make a bunch of tests if you want to ensure behavior. Formal methods have long been recognized. If a programmer is only now realizing their necessity due to LLM code synthesis, I do not trust the programmer with human-generated code, let alone LLM-generated code. I don't expect everyone to formally verify all code for many reasons, but the principles should always be present for any program more serious than a hobby project. Take a look at [0]. Cautious design is needed at all levels; if tests or formal methods are relied upon, they count.

[0] https://news.ycombinator.com/item?id=43818169