A site which eventually has no visitors will become irrelevant. Those with ad blockers will also often share links to said site which others without ad blockers will click on. If you block me on your website there are many others who will no longer be clicking through via the links I would otherwise have shared.