I've been wondering the same thing. It's possible that older pre-LLM data sources may become indispensable for training.

It would be both amusing and disturbing to see older Usenet, Slashdot, and Reddit conversations turned into rare and valuable resources.