Because of first sale doctrine. Anyone can set up a library by buying physical books, DVDs, or anything else they want to lend out to one person at a time without any sort of special permission. Digital library content, on the other hand, is based on specific contracts with the rights holders.