Distributing copyrighted works (prior to expiration of their copyright) verbatim is illegal.

Training an LLM on copyrighted works is not illegal.

This whole debate has been tried in court already. Calling it IP theft only stands on individual moral grounds, but the law allows for derivative works.