In "Me" by Thomas T. Thomas, novel thinking came from introducing random retrieval of memories in the entity. With vector search, this might include singleton outliers added to the prompt.

Just because the idea was expressed in science fiction, doesn't mean it's useful in the real world.

Solving a non-trivial problem that hasn't been solved before is not something random walks on text token probabilities will get you. Text production algorithms have the problem of being unable to detect whether the text produced is internally consistent, let alone true in the logical sense. These two qualities are required for creating net new solutions to unsolved next-level problems.