The problem of supporting authors who actually want to be paid more than beer money (or any money, really) for their work, for one.

There's also the problem of moving those books onto another platform once Amazon directly affects you and you wish to move onto something else. (Amazon Unlimited DRM hasn't been broken yet.)