News for hackers. Stuff that matters.
Re:52% of YouTube videos live in 2010 have been deleted by toomuchtodo on Thursday July 14, 2022 @01:49PM (#32099292)
Would love to crowdsource an effort to buy enough disk space to backup YouTube to the Internet Archive and have ArchiveTeam perform the archival op.

Assuming ~35PB of content stored at YT, should cost roughly $70M for IA to buy the necessary storage infra and maintain it into the future (their costs are ~$2/GB for perpetual storage).

Re:52% of YouTube videos live in 2010 have been deleted by the_biot on Thursday July 14, 2022 @03:02PM (#32100154)
If you've spent any time on YouTube, it's painfully obvious much of it is not worth archiving at all. Clearly if you had some critera to select videos that are worth preserving, this task would become a lot more doable.

But what could those criteria be?

You can't just select out all those fast-talking "influencers" that shill and lie their way through hours worth of video just because they're shit, because sometimes those videos have thousands of people that DO like them, making them perhaps interesting to a sociologist 300 years from now.

2000-year old Roman shopping lists, personal letters and obscene graffiti are intensely interesting to historians now, but would have been worthless to their owners even a couple of days later.

Re:52% of YouTube videos live in 2010 have been deleted by themadprogramer on Thursday July 14, 2022 @03:53PM (#32100714)
You have to, however, also consider the multi-domainness of YouTube videos. Yeah sure, there's billions of hours of clips not one person can watch in a single life-time. But unlike your 2000-year old Roman shopping lists, we have footage of events that are anchored to a particular time-period. Or location.

One of the most impressive things you can do is, try searching up a landmark. My personal favorite is the [Jumping Stone](https://www.youtube.com/watch?v=u1TtMN8nXTM) on the Nias Island of Indonesia. What would have otherwise just remained a novel tourist attraction, forgotten by the modernity of the 21st century, is now essentially a "tag" which has hours of footage associated with it. Thousands of tourists travelling back and forth, locals growing old, new people being born, buildings being built and demolished around it. You can even just study how video quality improved in that particular region. That there IS something wholly unique to this era and definitely worth preserving. YouTube as a company has figured the logistics of storing it, but the question of how humans can hope to read such data remains yet unanswered.

Re:52% of YouTube videos live in 2010 have been deleted by the_biot on Thursday July 14, 2022 @04:22PM (#32100983)
Like so many questions of this type, I think the Internet Archive is the answer. They are not a warehouse of stuff stored on media/formats that are forever becoming obsolete -- they store data, keyed by timestamp, sometimes with metadata. How they store it and serve it up is irrelevant, and they will upgrade as needed (I assume this is a continuous process).

If the IA didn't exist, we'd have to invent it.

I suspect if the IA ever decides to properly archive YouTube, they'll interface with the folks that run it directly. Archive Team is, to put it as diplomatically as I can, not a good organization.

Re:52% of YouTube videos live in 2010 have been deleted by soraminazuki on Thursday July 14, 2022 @06:48PM (#32102325)
I don't think that's a complete answer though. The article lists ContentID as the major reason videos get deleted, meaning that copyright trolls could go after IA if they want to. What we desperately need is copyright law reform.
Re:52% of YouTube videos live in 2010 have been deleted by bshipp on Thursday July 14, 2022 @09:20PM (#32103506)
I'm not 100% positive, but I recall a conversation we had on TheEye a while back with some IA reps and they simply can't archive YouTube. I recall a private project to archive just the video Metadata ended up in the hundreds of Terabytes. The videos themselves must be a gargantuan collection. Most YouTube archiving thus far is pretty much done and maintained by private individuals.
Re:52% of YouTube videos live in 2010 have been deleted by Wowfunhappy on Friday July 15, 2022 @08:09AM (#32107255)
The Internet Archive has a lot of stuff they don’t make available over the internet.

A couple of months ago, they sent me a thumb drive of some stuff I requested (for a nominal processing fee).

Re:52% of YouTube videos live in 2010 have been deleted by the_biot on Friday July 15, 2022 @01:23PM (#32110582)
I'm surprised to hear that, what's the point of keeping stuff they don't make available? What sort of stuff is this?
Re:52% of YouTube videos live in 2010 have been deleted by Wowfunhappy on Friday July 15, 2022 @02:19PM (#32111223)
Well, they do make it available, just not over the internet, I assume for legal reasons.

In my case it was some TV footage broadcast on the evening of September 10, 2001.

Re:52% of YouTube videos live in 2010 have been deleted by themadprogramer on Thursday July 14, 2022 @05:17PM (#32101568)
> If the IA didn't exist, we'd have to invent it.

You know, a part of the original company vision for YouTube prior to the Google acquisition was really something akin to the IA, in that they did pride themselves with hosting footage of the Indian Ocean Earthquake:

https://www.youtube.com/results?search_query=Indian+Ocean+ea...

Now, acting as diplomatically as I possibly can, I can say that your suggestions of the IA and YouTube interfacing together were at a previous point in time a continuous process. But a number of factors have made direct cooperation between the IA and Google (thereby YouTube) come to a screeching halt.

At this current point in time, we stand at a historical crossroad. And I'm only here to just act as a humble messenger ;)

Re:52% of YouTube videos live in 2010 have been deleted by MrYellowP on Thursday July 14, 2022 @03:20PM (#32100397)
> 300 years from now

That's really unlikely, given it's all just digital and electricity. Ignoring that our pseudo-global society will have collapsed long before that and ignoring that the digital era unlikely lasts that long ...

... assuming humanity actually keeps going as it is ...

... there is no way people in 300 years will be able to read any device from today. Hell, the CD-ROM is dying and that's young.

Re:52% of YouTube videos live in 2010 have been deleted by virtuallynathan on Thursday July 14, 2022 @02:40PM (#32099902)
As of 2013, I calculated the YouTube catalog is ~375PB. It's probably closer to 1EB now, if not 2-5x that much.

http://www.autonomoussystem.net/2013/07/youtube-slowness.htm...

Re:52% of YouTube videos live in 2010 have been deleted by sterlind on Thursday July 14, 2022 @04:16PM (#32100940)
would tape be cheaper? it'd be a lot more annoying to use, but at least you'd have a backup, even if you have to queue a request to access.
Re:52% of YouTube videos live in 2010 have been deleted by booi on Thursday July 14, 2022 @04:27PM (#32101041)
Tape (~$6/TB) is cheaper than archival storage (~$14/TB) but I'm not sure it's worth the cost of having another "offline" system that needs robots or humans in order to access for rebuilds, maintenance, verification etc.

I'm surprised by how magnetic storage continues to decline in price as densities continue to increase. I wonder where the end actually is.

Re:52% of YouTube videos live in 2010 have been deleted by crmd on Thursday July 14, 2022 @05:48PM (#32101860)
You might be surprised to see the scale of LTO tape consumption by FAANG companies.
Re:52% of YouTube videos live in 2010 have been deleted by kevincox on Friday July 15, 2022 @07:10AM (#32106923)
Because at this scale the lower cost is worth it. For smaller scales the infrastructure and management overhead of tape is never repaid.
Re:52% of YouTube videos live in 2010 have been deleted by toomuchtodo on Thursday July 14, 2022 @02:42PM (#32099928)
Sad trombone.
Re:52% of YouTube videos live in 2010 have been deleted by themadprogramer on Thursday July 14, 2022 @02:43PM (#32099933)
Maybe someone should do a Kickstarter for it ;)