> why is this a problem if the publisher doesn't want a third party to use their work without their permission, or at all?

Because it often breaks accessibility tools used by the blind, for instance.

It also has a potential to break the social contract that copyright is based on. Copyright doesn't last forever, but most DRM schemes that I know of don't suddenly go away when the copyright term ends.