News for hackers. Stuff that matters.
Re:Let's Talk about LLMs by paganel on Monday May 04, 2026 @05:41PM (#48015407)
> , it tests N(x) faster.

It does? You mean "it tests itself faster", which is not really a test now, is it?

Re:Let's Talk about LLMs by cfloyd on Monday May 04, 2026 @05:56PM (#48015529)
I use one model for coding and another writing tests for that very reason. It’s surprisingly good at TDD
Re:Let's Talk about LLMs by guille_ on Monday May 04, 2026 @07:20PM (#48016230)
I find this fascinating because it's the sort of anthropomorphism that betrays a fundamental understanding of what an LLM is. Language models are not people. You can just achieve the same thing with a fresh context window. The only solid technical reason you'd want a different model is if you find a certain model produces better code and another produces better reviews. Nobody has really tested this, of course.
Re:Let's Talk about LLMs by Izkata on Tuesday May 05, 2026 @12:29AM (#48018046)
I believe the theory isn't that one is better than the other, but that different models would make different mistakes, so you can be more confident in the places where the code and tests agree.
Re:Let's Talk about LLMs by kefirlife on Monday May 04, 2026 @06:17PM (#48015702)
I read that to mean you can arm it with a harness that you design informing the user that tests pass. A LLM can leverage this to run tests faster than I would run the same harness myself. You can then have any programmatic logic needed to support that usage sufficient to cover your use case and have a degree of certainty that the product at least passed those tests.