News for hackers. Stuff that matters.
Re:Claude Opus 5 by amoss on Saturday July 25, 2026 @11:19AM (#49048300)
I think it is uncontentious that we are not designed at all. But to address the intended spirit of the question: are we restricted to output that is a close fit for our training set?

I would argue that we are not - because we do not have a rigid partition between training/test. Our ability to reason speculatively rests to some extent on ability to produce outputs that we have not seen before and which are statistically not like that which we have already seen. How we know which of these outputs to keep, and which to discard is (afaik) an open question.

Re:Claude Opus 5 by throw-the-towel on Saturday July 25, 2026 @11:30AM (#49048416)
But can we say that the LLMs are consciously designed? AFAIK nobody really understands why they work.
Re:Claude Opus 5 by amoss on Saturday July 25, 2026 @05:00PM (#49051509)
Whether they are or not is irrelevant to the difference- there is still an explicit division between training and inference, with reinforcement of the statistics of the training set.