It's also helpful when they use the links as intended, like the video links to its own follow up video at the end.
I can totally see how these features could be abused by some channels, though.
Getting rid of them entirely would get rid of an easy and much needed way for the uploader to add corrections and other additions after the fact.
I do see videos where the annotations are rather annoying, but I don't think it's so often that it has been a terrible problem overall, and I have a suspicion that on those videos the annotations have not been the only annoying aspect.
Edit: I just saw further down that annotations are actually deprecated, and now I really wonder how people can add corrections to videos? Does that mean I have to read the description of every video I watch?
I just regard annotations and commercials (which aren't blocked by uBlock Origin) as part of a video. If you (or I) don't enjoy a video (for whatever reason), stopping watching it is always an option to consider.
But YT should let them link externally. Site's like Patreon are beneficial to everyone involved.