It isn't quite possible to block youtube-dl but not other ways of accessing YouTube. However, if you're downloading a lot of videos from one IP address, Google will blobk your IP from accessing YouTube. I know this because it happened to me after I ran a service to allow people to make gifs from YouTube videos, and the way I got them was with youtube-dl. After a while (about two years) they blacklisted my IP.