News for hackers. Stuff that matters.
Re:Andrej Karpathy: Software in the era of AI [video] by klabb3 on Thursday June 19, 2025 @07:56AM (#44317798)
> I think that if you give the same task to three different developers you'll get three different implementations.

Yes, but if you want them to be compatible you need to define a protocol and conformance test suite. This is way more work than writing a single implementation.

The code is the real spec. Every piece of unintentional non-determinism can be a hazard. That’s why you want the code to be the unit of maintenance, not a prompt.

Re:Andrej Karpathy: Software in the era of AI [video] by imiric on Thursday June 19, 2025 @09:08AM (#44318372)
I know! Let's encode the spec into a format that doesn't have the ambiguities of natural language.
Re:Andrej Karpathy: Software in the era of AI [video] by klabb3 on Thursday June 19, 2025 @11:10AM (#44319386)
Right. Great idea. Maybe call it ”formal execution spec for LLM reference” or something. It could even be versioned in some kind of distributed merkle tree.