News for hackers. Stuff that matters.
Re:Handbook.md shows that long policy documents do not relia... by Aurornis on Wednesday July 29, 2026 @04:28PM (#49102608)
> This is a bit of a strawman. The parent comment wasn't suggesting that the inherent defects magically disappear

The parent comment literally said that the common LLM defects would go away.

Direct quote:

> all of the common LLM defects will go away

Re:Handbook.md shows that long policy documents do not relia... by adrian_b on Thursday July 30, 2026 @03:55AM (#49107156)
Clearly it was meant that they will go away only if you use a custom harness, without the defects that now exist in all vendor-controlled harnesses, because of the non-aligned goals of the vendor and of the user.

While it was not spelled explicitly, it should be obvious that nothing can be improved if you run locally an LLM in the same way as the vendor. But you should not do that. It is easy to use better methods for sampling procedures and for prompt and context handling.