Children produce novel sentences all the time, simply because they don't know how stuff is supposed to go together. "Novel content" isn't a step forward. "Novel content that is valid and correct and possibly an innovation" has always been the claim, but there's no mathematical or scientific proof.

How much of this stuff is just a realization of the classic "infinite monkeys and typewriters" concept?