>it is content that you already have a right to see //
You have opportunity, that's not the same as a right. The content supplier is under no obligation to provide content to you, ergo no "right to see" that content.
That said, personal time-shifting and format-shifting should IMO be a normally allowed part of the copyright deal.
The one place I can see where this breaks down is in advertisements, but I consider that to fall into the incidental results. (Although Youtube-dl does have a --include-ads option)