I also still don't understand why yt recommendations are as poor as they are. I've tried taking the time to try removing certain things from the "recommendation history" (or whatever they call it), flag recommendations I'm not interested in etc and it does improve things a bit but still it recommends things I would never watch in a million years (eg right now I have 4 Joe Rogan recommendations on my homepage even though I've literally never watched any of his things and have zero interest in ever doing so, and click on every one and say not interested etc, for a while it was obsessed with trying to get me to watch MMA content even though I can't bear watching other people hurt each other).
And the whole issue of recommending videos where it knows I've watched the whole thing, I just don't even know where to start.
This is a different strategy to Google web search, where the monetisation occurs on the search results page (via ads there) rather than on click-throughs, so there isn't an incentive to try and get you to click several tangentially related links.
if you regret clicking on it, that means you did click on it and the recommendation did it's job; remember that the job of the recommendation engine is not (directly) to suggest content you'll like, it's to suggest content that will get you to click. Ideally those goals would be aligned, but not necessarily. YouTube is simply incentivised (via ad revenue) to get you to click on as many videos as possible.
So while it may not be overly successful on you (i.e. you only click occasionally), if it works on a significant portion of people it could still be a successful strategy overall.
I use both YouTube and Netflix pretty extensively. These companies are both held up as ML success stories. But, at least in my personal experience, they suck! My front-page feeds consist of (1) content that the platform knows I have already seen because IT IS IN MY WATCH HISTORY, (2) content that is trivially related, like by having the the same channel/director/actors, and (3) random junk I have no interest in watching and always regret clicking on.
It's not that the content isn't out there -- I'm able to find stuff I like through "big spreadsheet of all the Netflix movies" websites, online recommendations from humans, and YouTube channel crossovers/cameos. But I've never had that magical "the algorithm knows you better than you know yourself" experience that every ML engineer I've ever spoken to seems to be convinced their systems achieve.
Are all ML engineers mindless drones with exactly average movie preferences, or am I some kind of incomprehensible weirdo?