> But turning the internet into a hall of mirrors of entirely fictional content that looks "truthy" but in fact advocates for all sorts of things will destroy its usefulness and that of the society that relies on it.

Humans already did that without LLMs. Relaying content which is designed to look truthy while advocating things is one of the main uses of the internet.