> And there should not be an option to override that.
This is not just a sane default. This is software telling you what you are allowed to do based on what the rights owner wants, literally DRM.
This is exactly like Android not allowing screenshots to be taken in certain apps because the rights owner didn't allow it.
If I create an open-source messaging app I am also not going to give users the option of clicking a button to spam recipients with dick pics. Even if it was dead-simple for a determined user to add code for this dick pic button themselves.
I really wonder if it's bots or just assholes.
He was using DRM as a metaphor for restricted software. And advocating that software should do whatever the user wants. If the user is ignorant about the harm the software does, then adding robots.txt support is win-win for all. But if the user doesn't want it, then it's political, in the same way that DRM is political and anti-user.
Oh no, someone on the internet found something offensive!
Parent commenter merely and humbly asks the author of the library to make sure that it has sane defaults and support for ethical crawling.
I find it disturbing that you would recommend against that.