There's plenty of websites where you can download drm-free pdfs/mobis of most of the world's texts (at least I can attest for English, I'm less familiar with other languages).

I also usually buy paper books. If you buy the book, you shouldn't feel particularly guilty for "acquiring" the pdf/mobi. :)