You: Yes, and you know how humans acquire works to learn from? They pay for it.
Them: False. Libraries exist. Borrowing books from neighborhood libraries or friends exists.
You: Libraries exist? Do you think books fly onto library shelves for free? As far as I know, someone bought them.
Them: then [pick] up a book from a normal ... library, [show] it to an OCR system, and [have] an AI learn from that
You: Everybody finds an edge case they can justify their entire worldview on.
However, it's not an edge case; it's a direct consequence of your argument. If humans learning from libraries rewards copyright holders because libraries paid for the books, then an AI training from libraries rewards copyright holders in exactly the same way since the libraries paid for the books.