News for hackers. Stuff that matters.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by ravenstine on Monday June 18, 2018 @11:53AM (#17339175)
I know this is just filtering for now, but I've been backing up entire channels for fear they'll one day disappear because global policy or legacy media conglomerates won't allow for it. I imagine the "you" in YouTube will be mostly gone in the next decade. The writing's on the wall.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by ballenf on Monday June 18, 2018 @12:30PM (#17339531)
The really frustrating aspect is that one would need to implement advanced search functionality on those videos otherwise the more you archive the less chance you have of finding anything.

The "hosting" aspect of YouTube is really a small part of why the service dominates. The connections between channels and links from one video to another channel -- network effects and discovery -- are what make disrupting YT seem impossible.

Kind of crazy given how YT originated in juvenile joke vids, but YT may have the potential to become Google's biggest source of revenue despite any number of overbearing content policies. The new ads below videos for products of potential interest based on the video content are annoying but probably very profitable.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by chii on Tuesday June 19, 2018 @07:35AM (#17345626)
> network effects and discovery -- are what make disrupting YT seem impossible.

i highly doubt that. The youtube monopoly is due to both audience, and the monitization model available (which, atm is getting shoddier and shoddier every day with random demonitizations).

Hosting is a big issue, but it's a technical issue, and other platforms (such as vemeo, or some other platform) has "solved". But those platforms don't dominate (or even show up as a blip!) because content creators can't use them to make their living.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by JTbane on Monday June 18, 2018 @01:32PM (#17340040)
>I've been backing up entire channels for fear they'll one day disappear because global policy or legacy media conglomerates won't allow for it.

Not a bad idea, as entire channels have gotten the boot for much less, from Youtube itself.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by michaelsjoeberg on Monday June 18, 2018 @12:15PM (#17339377)
i have been doing the same, in particular unofficial music remixes, which likely will disappear at some point and not allowed on spotify etc.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by ravenstine on Monday June 18, 2018 @01:22PM (#17339951)
There's a lot of fan made instrumentals out there(of astounding quality) that I've been archiving for fear of losing forever.

I learned my lesson after Nintendo went berzerk and requested takedowns for gameplay videos and walkthroughs; smashrockgroin's series for Goldeneye 64 was both funny and informative when playing that game, but now those videos are gone forever. I've vowed never to buy a Nintendo product again because of that alone.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by userbinator on Monday June 18, 2018 @08:31PM (#17342817)
I learned my lesson after Nintendo went berzerk and requested takedowns for gameplay videos and walkthroughs

Going after pirates and such I can sort of understand, but people enjoying your product (and obviously helping to promote it)? WTF.

It reminds me of the complete opposite of this old meme: http://lurkmore.so/images/9/94/360_Kid.jpg

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by TeMPOraL on Tuesday June 19, 2018 @01:51AM (#17344111)
> but people enjoying your product (and obviously helping to promote it)? WTF.

The usual rationale is that walkthroughs / let's play videos show enough of the game that people may opt to just watch the video, instead of playing the game itself.

I can sort of understand this position when it comes to videos that e.g. show the entire single-player campaign with zero commentary. But I'm not convinced that people opting for such videos would have bought the game if the walkthroughs were not available.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by chii on Tuesday June 19, 2018 @07:38AM (#17345637)
> I'm not convinced that people opting for such videos would have bought the game if the walkthroughs were not available.

also, if the game has nothing else to offer when compared to a video playthrough, may be it's the game that has the problem!

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by TeMPOraL on Tuesday June 19, 2018 @08:50AM (#17346064)
Not necessarily. Story-rich games are essentially one-time only experiences, even if they are very fun to play through.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by krageon on Thursday June 21, 2018 @09:17AM (#17364778)
Just like a good book, a good story-rich game invites you to experience it more than once. Even if it is just to notice nuances you missed the first time.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by reificator on Monday June 18, 2018 @01:11PM (#17339867)
If we lose Mouth Moods[0] it will be a horrific cultural loss for the internet itself. Bustin' actually came up next on my "everything" playlist while I was typing this comment.

[0]: http://www.neilcic.com/mouthmoods/

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by oliveshell on Monday June 18, 2018 @08:26PM (#17342791)
Thankfully— at least in this case— Neil offering the album as a free lossless download on his website means countless archival-quality copies are saved on PCs the world over!
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by reificator on Monday June 18, 2018 @08:54PM (#17342925)
Yep, though I must admit I downloaded the lossless and uploaded it straight to Google Play Music where it gets converted to lossy.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by nomel on Monday June 18, 2018 @10:56PM (#17343482)
Another reason to backup HD Youtube videos is that they'll "demote" them to SD if they don't get enough views.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by lucb1e on Tuesday June 19, 2018 @01:59AM (#17344135)
I've never heard or seen that. Seems weird as well. Source?
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by thecatspaw on Tuesday June 19, 2018 @07:29AM (#17345586)
they are probably talking about their caching. Videos with low views are not cached at all servers, especially not higher definitions. So you want to watch the video, the server realizes "oh hang on, I threw this one out, let me grab it again from another server". while the server fetches the fullHD video, you get it in 360p
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by lucb1e on Tuesday June 19, 2018 @07:31AM (#17345602)
I recently had a video with very low views that just wouldn't load for minutes on end. Was wondering if they were down, or if it had to be grabbed from some tape archive because a disk crashed. After about 10-15 minutes, it slowly loaded. This was at all qualities, browsers, and even when trying from another continent.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by Aaronn on Tuesday June 19, 2018 @02:54PM (#17349315)
Is that true? Do you have a source on that?
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by nomel on Sunday June 24, 2018 @03:10AM (#17385387)
Maybe I'm an isolated case, but many of my videos from 5 years ago with few views.

They were filmed on a Nikon DSLR in 1080p. A few weeks after uploading they were fine, 1080p. Several months later, I noticed a few were 720p, and now many are 480p, but a extremely poor quality 480p that looks more like < 240. For a few that are still 720p, and some that are 480p, the framerate has been reduced to maybe 4 fps.

Maybe it was the codec Nikon was using, but regardless, they're basically gone, and I no longer consider Youtube a "safe" place for videos.

I would send links, but I don't want to dox myself.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by amatecha on Monday June 18, 2018 @12:09PM (#17339338)
Nice, do you have any summary of what process you take to back up channels? I've considered the same in the past, but found that there are a lot of crappy/sketchy plugins, and not too many legit/decent ones that actually get the highest quality copy of the content.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by icebraining on Monday June 18, 2018 @12:10PM (#17339346)
youtube-dl is great for this, you can run it periodically against a channel and only download new videos. See the --download-archive option. Using "-f best" will fetch the highest quality format, but you can be more specific with filters like "-f best[filesize<50M]".
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by ascom on Monday June 18, 2018 @01:25PM (#17339979)
I actually use -f bestvideo+bestaudio, since it downloads and muxes the best combination of DASH video and audio.

ArchiveTeam also has a recommended list of flags for archival: https://www.archiveteam.org/index.php?title=YouTube

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by Mashimo on Tuesday June 19, 2018 @02:46AM (#17344299)
>I actually use -f bestvideo+bestaudio,

It does that by default. (If you have ffmpeg)

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by ravenstine on Monday June 18, 2018 @02:00PM (#17340259)
Thanks! I'll be doing this from now on. Had no idea about that.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by morganvachon on Monday June 18, 2018 @04:09PM (#17341279)
I'll throw in my vote for youtube-dl as well. I love that it's so cross-platform; there's even a port for OpenBSD which makes it super easy to enjoy YT videos on that OS without having to run a resource-heavy browser, and it can be scripted.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by ravenstine on Monday June 18, 2018 @01:13PM (#17339881)
Yeah, I'm basically doing what you describe:

`youtube-dl -f best -citw -v <url of channel or playlist>`

If I recall, that's going to ignore errors. At an airport right now so I can't remember exactly what those flags are.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by jwilk on Monday June 18, 2018 @03:58PM (#17341192)
youtube-dl has this in their FAQ:

> Do I always have to pass -citw?

> By default, youtube-dl intends to have the best options (incidentally, if you have a convincing case that these should be different, please file an issue where you explain that ( https://yt-dl.org/bug )). Therefore, it is unnecessary and sometimes harmful to copy long option strings from webpages. In particular, the only option out of -citw that is regularly useful is -i.

But OK, here's explantion of the options you used:

• -f best: Select the best quality format represented by a single file with video and audio. (By default, yt-dl will merge best video with best audio if that's what's available.)

• -c: Force resume of partially downloaded files. (By default, yt-dl will resume downloads if possible.)

• -i: Continue on download errors, for example to skip unavailable videos in a playlist.

• -t: Use title in file name. (Deprecated. This is the default.)

• -w: Do not overwrite files.

• -v: Print various debugging information.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by earenndil on Monday June 18, 2018 @02:52PM (#17340695)
I thought it already fetches the highest quality by default?
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by d0lph on Wednesday June 20, 2018 @10:26AM (#17355675)
It has for a while.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by amatecha on Monday June 18, 2018 @12:33PM (#17339558)
Really! I had no clue about this one (it has been a while since I searched around for such a thing).. that's great! Thanks for the tip, I'll check it out.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by walterbell on Monday June 18, 2018 @12:16PM (#17339393)
Recommended storage device and disk drives?
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by toomuchtodo on Monday June 18, 2018 @12:58PM (#17339748)
https://www.backblaze.com/blog/open-source-data-storage-serv... ; it's what I use to keep anything in cold storage that can't immediately go into the Internet Archive or that they're unable to dark after I upload.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by craftyguy on Monday June 18, 2018 @01:10PM (#17339858)
Wait so you bought a $10k 60 disk storage platform? Or built one?
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by toomuchtodo on Monday June 18, 2018 @01:32PM (#17340047)
Built (several). My background in tech is ops/infrastructure/networking/devops.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by craftyguy on Monday June 18, 2018 @01:36PM (#17340077)
That's awesome. I would like to build something similar, though maybe scaled down to 1/2 size/capacity. Did you follow their parts list exactly or deviate (e.g. what did you use for chassis since theirs is custom)?
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by reitanqild on Monday June 18, 2018 @03:33PM (#17341017)
> what did you use for chassis since theirs is custom

FWIW, in addition to their awesome disk stats Backblaze also provides blueprints for their chassis as well as a BOM for the parts inside

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by craftyguy on Monday June 18, 2018 @04:47PM (#17341570)
> Backblaze also provides blueprints for their chassis

Wow, I had no idea they did that. I definitely have a new respect for them.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by icebraining on Monday June 18, 2018 @01:35PM (#17340063)
What does "dark" mean in this context?
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by toomuchtodo on Monday June 18, 2018 @01:42PM (#17340123)
Publishing of content that would cause legal or other harm to the Internet Archive. It’s still stored on disk, but not accessible.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by toomuchtodo on Tuesday June 19, 2018 @04:35PM (#17350104)
To clarify, to “dark” an object is to make it unavailable but continue to store it.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by yizzy on Monday June 18, 2018 @02:08PM (#17340306)
You can also use Yizzy[0]. It’s just a GUI on top of youtube-dL but it’s very easy if you don’t like command line. It’s only MacOS compatible by default but should work anywhere if you change the python path. Like youtube-dl it also allows you to download whole playlists by just pasting the link.

0 - https://github.com/biko-the-bird/Yizzy

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by chii on Tuesday June 19, 2018 @07:40AM (#17345645)
also https://github.com/MrS0m30n3/youtube-dl-gui

and there are plenty of others too.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by dilap on Monday June 18, 2018 @02:29PM (#17340499)
it's quite a shame. google are not being good chaperones of what has become an amazing service and resource.

hopefully a completely decentralized replacement will arise.

(OT: wow, HN strips emoji!)

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by Silhouette on Tuesday June 19, 2018 @07:42AM (#17345664)
hopefully a completely decentralized replacement will arise.

Ironically, we used to have a nice, decentralized Internet, and services like YouTube have been probably the biggest cause of damage to it.

Not so many years ago, everyone got a bit of web space and their own URL along with the connection from their ISP. You could put your own web site there, for all to see. Many ISPs would allow running some basic software. Visitors would find these sites through search engines or [gasps] manually created links from other sites with relevant material.

An analogous service today would probably involve providing a useful amount of space and bandwidth, and probably some ready-made blogging or video hosting software so non-geeks could just start creating something instead of having to install anything first. But in reality, almost no ISPs (at least here in the UK) routinely offer that sort of service any more, because the likes of YouTube and Medium have killed it.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by dilap on Tuesday June 19, 2018 @07:56AM (#17345732)
i do think the search, recommendations, following, ease-of-uploading, and unlimited hosting capacity that youtube gives you are of real, incredible value. i can find videos on youtube of how to do practically anything, uploaded by every kind of person imaginable.

practically speaking, people creating their own webpages and hoping to get indexed by a search engine or included in a hand-curated directory is not going to get anywhere close to that. you restrict your creators to a tiny, tiny fraction of the population w/ those skills.

so the trick is how to have the great ux of these centralized services without the downsides of centralized control. seems like there's a good chance it's possible.

(for other services, we did used to have (well, still do) pretty good decentralized variants. slack vs irc, reddit/hn vs newsgroups, email vs fb messenger. but even the more minor usability improvements of the centralized alternatives seems to be enough for them to displace what came before. maybe the tide will swing back.)

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by Silhouette on Tuesday June 19, 2018 @09:58AM (#17346638)
i do think the search, recommendations, following, ease-of-uploading, and unlimited hosting capacity that youtube gives you are of real, incredible value.

They're certainly useful. I just question whether we wouldn't have found other ways to achieve these kinds of benefits if we didn't have YouTube, with the entire Internet interested in the results and well over a decade to come up with something.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by dilap on Tuesday June 19, 2018 @06:39PM (#17350857)
perhaps. hopefully we still might.

random example of youtube shittiness i just stumbled over:

https://twitter.com/cmuratori/status/1009197617408954368

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by emodendroket on Monday June 18, 2018 @03:04PM (#17340807)
What reason is there to think it would? There used to be a bunch of services YouTube competed with; now few of them are even worth mentioning, let alone serious competitors.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by dilap on Monday June 18, 2018 @07:17PM (#17342411)
i think there's a couple of reasons for optimism:

1. high-speed net access is becoming more and more common; higher speed help makes the possible overhead of distributed solutions less of a barrier

2. there is more awareness now of the downsides of having a centralized provider. many youtube creators and users have been burned by google; i think that'll generate real demand for a decentralized solution.

3. existence/arguably success of decentralized currencies provides a lot of psychic energy/motivation for making decentralized things.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by kakarot on Monday June 18, 2018 @08:02PM (#17342674)
Same here. Backing up a lot of channels I like but also lots of music videos, interviews, live shows, informational videos, etc.

Hopefully the next great online video service will have support for displaying the original encoding for uploaded videos, saving them all another generation of quality degradation due to transcoding.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by stordoff on Monday June 18, 2018 @07:49PM (#17342598)
I've been doing the same to back up fan translations of various things. Almost certain they will disappear to some point, as they are definitely infringing, but it's the only way I can enjoy those media (most of which I otherwise own).
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by nkrisc on Monday June 18, 2018 @01:34PM (#17340061)
Out of curiosity, what sorts of channels/content are you backing up?
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by ravenstine on Monday June 18, 2018 @02:09PM (#17340311)
People have a tendency to misundertand everything I do, so I'd rather not get into specifics, but in summary:

- Intellectual discussions

- Fan made instrumentals and remixes (especially for Rammstein)

- Found footage, old shows, and other nostalgic material from VHS tapes. (wouldn't surprise me if they get flagged for having Folgers commercials from 1993)

- Random funny videos with swearing or vulgar language

Not a whole lot of things that are likely to be relevant to most people, but I've a culture of my own and I'd like to preserve that. To forever lose something I enjoy means losing a bit of myself and not being able to share that with others.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by jlykins on Monday June 18, 2018 @05:58PM (#17341980)
I've been thinking a lot lately about how various small internet subcultures and communities that I've been a part of have been lost to the void. It's one of those things that makes me a special kind of sad and nostalgic.

Would you be at all interested in software that helps to construct a permanent showcase of the stuff that matters to you? It would handle things like archiving to enable a focus on curation and presentation.

I've been thinking of making something like this because services like the internet archive don't seem quite right. There's no context. I just worry that nobody would be interested in doing the work of providing that context.

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by ravenstine on Tuesday June 19, 2018 @09:08AM (#17346201)
Yeah, I'd definitely be interested in seeing something like that.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by nkrisc on Monday June 18, 2018 @03:59PM (#17341206)
That definitely seems like the kind of content that would end up getting removed, but ironically is the kind of the content that services like YouTube grew up on.
Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by thinkingemote on Tuesday June 19, 2018 @04:34AM (#17344726)
How do you back up these? Just to a drive on your PC? To a network drive / server etc?

And what software do you use? Streamlink?

Re:YouTube’s Piracy Filter Blocks MIT Courses, Blender Video... by ravenstine on Tuesday June 19, 2018 @09:06AM (#17346184)
I have a hard drive connected to a Raspberry Pi with Samba installed. Samba is terribly slow, so I just ended up bypassing that and installing youtube-dl directly on the Raspberry Pi. I'd like to find a more robust solution, but for now that works.

Streamlink looks like a great project. Thanks for mentioning it!