And what does the training data then do? Just sit in a box, or produce content for "direct human consumption" that would have market impacts?

If all anyone has to do to invalidate copyright law is introduce an intermediary step where it is used for a non-consumption purpose, then copyright is already dead.