It can come up with something novel, but only by combining whatever present, which can be granular enough to be completely different. But to truly nudge it, you need precise prompting and a good harness. But I’m more likely to credit those and the people creating them. As well as the data that goes in the training. I won’t praise Fable or Opus. It would be like praising the pencil or the hydraulic press.
I think the Turing Machine, the Von Neumann Architecture, …, Unix, …, The IBM PC,… as more awe-inspiring because those has truly helped humanity. I still can’t see the positives of LLM technologies.
Re:Claude Opus 5
by jason_oster on Saturday July 25, 2026 @11:48PM
(#49054516)
> It can come up with something novel, but only by combining whatever present
That's what artists do. Long before LLMs, Kirby Ferguson made this observation in "Everything is a Remix" [1] in the context of Copyright and IP disputes. He has since updated it with a chapter explaining how GenAI works on the same principles. In short, "combining whatever present" is the only source of novelty.
I reject this idea that an LLM couldn't come up with something novel that isn't in the training data. We know it can come up with sentences that aren't in there. We know it can come up with mathematic proofs that aren't in there. So could it feasibly create something as fundamental as writing or language? Would we even be able to understand what it had done, or would it be so foreign to us that we wouldn't even realize?
Those early writers did have a training set of human knowledge that led them to pushing stones into clay. And our agents may very well have a set of knowledge that leads it to pushing their proverbial stone into their proverbial clay too.