News for hackers. Stuff that matters.
Re:Software is breaking down at a systemic level by jltsiren on Monday November 16, 2026 @02:03PM (#50521492)
That just follows from the fact that people can learn. Human organizations always have to balance between tacit knowledge and explicit documentation. Document too little, and onboarding new people will be more difficult, and you will lose information when people quit. Document too much, and you are just wasting time without doing anything productive, because people would have figured out that extra information in less time than it took to write it down.

The fundamental problem is that current AI tools don't learn. They make the same mistakes over and over again, unless you give them explicit instructions to avoid those mistakes. Maybe we need to accept that all work is now done by new hires, who have read all the documentation but have no experience in anything. Or maybe AI tools will get better, and all that tedious documentation effort was just a waste of time.

Re:Software is breaking down at a systemic level by CharlieDigital on Monday November 16, 2026 @02:10PM (#50521599)

    > The fundamental problem is that current AI tools don't learn
They don't learn, but they are very, very good at searching. That is why writing things down is important, but so is getting that into some sort of agent accessible index.
Re:Software is breaking down at a systemic level by pixl97 on Monday November 16, 2026 @03:35PM (#50522868)
>current AI tools don't learn

and

>and all that tedious documentation effort was just a waste of time.

Seeing where the AI is failing and then putting out good public documentation is a good way to ensure the next released model learns.

Re:Software is breaking down at a systemic level by jltsiren on Monday November 16, 2026 @04:24PM (#50523497)
Public documentation can help to mitigate the issue, but only with information that can be released to the general public, and only if it can be easily put into words. But as long as there is a separation between training and inference, the divergence between what the model knows and what it should know only grows wider over time.

I've been one of the organizers of a relatively large RPG convention for ~25 years. If I had to write down all I know about that convention, it would easily take a year or two. Because most of that knowledge is not in a form that can be easily expressed in words. And in my day job as a scientist, a similar task would easily take 5–10 years.