I suppose the relative low value for low volumes of text makes this not a problem, but...

What about data that's sitting around and isn't supposed to be public? If training data gets scarce, does a market for small-medium sized data emerge? Like old homework papers, internal company documents, etc?