News for hackers. Stuff that matters.
Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by tripzilch on Thursday March 22, 2012 @09:57PM (#3743223)
So, 25 petabytes ... 25 million gigabytes. Anyone care to guess how much of this data is illegitimate? And how much of that is under MPAA's copyright?

Back-of-the-envelope calculation: Just did a search for "1080" on some unnamed site and it appears a bluray rip of a movie encodes to roughly 10GB. So that would be 2.5 million movies in 1080p quality. I don't think we've made that many, have we? Especially if you consider that movies that came out before the "high-definition era" are encoded to about a 10th of that size (700MB-2GB roughly, afaik).

Maybe I'm missing something obvious.

Not counting TV series for instance (are they also intellectual property represented by the MPAA? I'm not in the USA so I never really dug into that).

Movies duplicated in different quality formats are usually a 10th or less of the size of a 1080p Bluray rip as well, as an upper limit I could add a factor of x1.5 for that.

But then, the "long tail" of movie rips are 700-800MB and do not have duplicates.

Unless ... is the MPAA also representing porn? Because then all bets are off and I can easily accept that this 25 petabyte consists mostly of MPAA protected intellectual properties.

But otherwise, what percentage of these 25 petabytes would you estimate actually represents illegitimate data owned/represented by the MPAA? 2% ? 10% ?

Is that fair to the owners of the other 90% of the data? Even if it's probably mostly porn? (I'm fairly sure most of the data has to be porn)

I'm just wondering. Also because it's interesting to speculate what could be in these 25 petabytes. If you have a better guess I'd love to hear it :)

Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by bigiain on Thursday March 22, 2012 @11:29PM (#3743513)
Think of the problem from the opposite direction. What the hell _else_ could the bulk of that possibly be?

I've got 4TB of storage on my media server, last time I checked at ~60% used.At _best_, possibly 0.5% of that is stuff that I've personally created and have copyright over. Hell, all the email I've sent _or recieved_ that wasnt spam filtered since mid 1995 only comes to a few hundred meg - including attachments! Smething less than half a TB of it is music which I have some kind of right to have as digital files (some of it purchased as files, some of it ripped from cd and vinyl - which is somewhat less clear legally with respect to my rights to have a "copy" as a file on my hard drives). Realistically, outside of academia and industry (who presumably aren't significant users of MegaUpload) chances are so close to 100% that any 1GB+ file is copyright encumbered in a way that gives the MPAA an interest that it doesn't matter. The nearest I cold come to justifying the rest is that some of it it "time shifted" TV (from the PS3 TV tuner/PVR), some of it is DVD backups for discs I own, some migh euphemistically be referred to as "timeshifted DVD rentals or loans", but a _lot_ is copyrited content found on "channel BitTorrent" or downloaded from YouTube. If the copyright police confiscated _my_ hard disks and catalogued them in front of a judge, I'd have a very hard time looking him in the eye and saying "I didn't think I was doing anything wrong!"

I fear that line of argument bodes badly for dotcom…

Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by prawn on Friday March 23, 2012 @12:11AM (#3743644)
"Hell, all the email I've sent _or recieved_ that wasnt spam filtered since mid 1995 only comes to a few hundred meg - including attachments!"

!!!

I drown in approximately 2GB/year and that's after deleting some stuff and many attachments. Do you make a lot of phone calls or hand-write letters? Or not run a business maybe?

Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by tripzilch on Friday March 23, 2012 @08:28PM (#3748008)
Just because you don't happen to have activities that generate enormous amounts of data doesn't mean nobody else does.

There's also people that make a lot more video data than you apparently do, same for sound recordings. Do you believe that the majority of recorded video data in the world is MPAA's? That would go against everything we know about the "long tail". You do realize that of all text (or books) written in the world, less than 1% actually gets published? Why would video or audio be any different? Just because you don't produce it, doesn't mean the MPAA industries are the only ones that do.

Also as you say, there's academia, PHD students I know use equipment that generates gigabytes per second. Or without equipment there's computer programs that do it from calculations. Now I agree it doesn't seem likely they'd use megaupload for that.

And that's just a few things I can come up with right now. Who knows what sort of computer stuff other people do that generates retarded amounts of data they need to share?

I'm also not saying that all that copyrighted stuff isn't there, it's just that if it's 25 petabytes worth of data, it just doesn't add up, the MPAA-represented copyrighted part of those 25 petabytes can only be a tiny fraction of that amount.

Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by bigiain on Friday March 23, 2012 @10:27PM (#3748270)
" … it just doesn't add up, the MPAA-represented copyrighted part of those 25 petabytes can only be a tiny fraction of that amount."

Interesting. My completely uninformed assumption is diametrically opposite to that. I'm guessing there's not much sophisticated de-dup going on, and _way_ more of the diskspace on MegaUpload is probably various bit-wise different rips of the same smallish set of Hollywood blockbusters. And while I agree the long tail suggests there's almost certainly lots of people out there with lots on non-mpaa-copyright encumbered files - I'd be quite surprised to find the area under the "long tail" was withing 2 or 3 orders of magnitude of the "fat head" occupied by all the copies of all the dvd rips and broadcast tv recordings.

I wonder if there's any believable data anywhere to see whether I'm wrong?

(Note: I've got a non-US-centric view of this too, here in Australia internet connection plans lag behind the US in terms of speed and bandwidth caps, so even though I've got friends who generate lots of GoPro footage for example, but they'll in general be storing them on locally attached harddrives, not trying to push gigabytes of raw data out into "the cloud". That might explain why I make tghe possibly-incorrect assumptions that I do…)

Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by bigiain on Thursday March 22, 2012 @11:41PM (#3743555)
Thoughts on ameliorating that risk…

If I start heading about individuals being charged for content they have on their own machines (as opposed to content they're sharing is p2p), I'll invest in a few OpenWRT capable wifi/adsl routers, plug in some large disks, distribute them amongst nearby friends/neighbors (or out-of-wifi-range friends with adequate bandwidth), and run Tahoe on them all in a configuration that means its _provable_ that my sections of the encrypted files do not contain enough to decrypt into any identifiable copyrighted work.

That's still not foolproof, but adding the requirement that "they" identify the existence of a network of storage devices all storing encrypted segments of files, and then having them need to confiscate enough of them as well as my disks should put me that one step ahead of the "lower hanging fruit".

Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by thezilch on Thursday March 22, 2012 @10:10PM (#3743254)
Frankly, the idea of pinning MPAA's actions on mostly protecting porn is a brilliant angle to fight back with in political arenas, where MPAA tries to draw human emotions and claims pirates are taking jobs away from honest people and our children are in trouble if pirates keep sharing their works.

Save your children; MPAA cares mostly to keep servicing them porn; end them now!

Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by tripzilch on Thursday March 22, 2012 @11:07PM (#3743445)
Thanks. Yeah, the porn bit didn't even occur to me as I started writing the post. I just wondered "25 petabytes is an awful lot of data, although numbers on data can get pretty big easily, let's see if I can come up with a reasonable estimate ...", and then, "... what else could be there? TV series--waitaminute--PORN!"

So yes, PORN.

(Unrelated, your username is awfully similar to mine..)

Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by nikcub on Friday March 23, 2012 @03:03AM (#3744038)
don't jump in the mud with them, keep yourself clean and argue user rights and freedom.
Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by DanBC on Thursday March 22, 2012 @10:45PM (#3743365)
As an idea of just how much a petabyte is, from their motion:

> Each petabyte is equal to approximately 1,000,000 (one million) gigabytes, or the storage capacity required to store “…about 13.3 years of HD-TV video. About 50 Libraries of Congress.” (http://www.nasa.gov/centers/langley/news/researchernews/rn_d...)

I was guessing games and software make up some data. I just had a look at a torrent site. They have 400 pages, with 25 items per page. At roughly 5 GB per item that's still only about 50 terabytes.

Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by nikcub on Friday March 23, 2012 @03:02AM (#3744033)
Megaupload has multiple copies of almost every single movie and TV show in the world in multiple formats and quality levels.

I have watched some very rare international films on Mega and it never failed me on a search.

If you multiply out all the movies, all the multiple copies, all the TV show espisodes, all the different quality levels, you would get a few petabytes.

Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by tripzilch on Friday March 23, 2012 @08:38PM (#3748028)
> Megaupload has multiple copies of almost every single movie and TV show in the world in multiple formats and quality levels.

> I have watched some very rare international films on Mega and it never failed me on a search.

> If you multiply out all the movies, all the multiple copies, all the TV show espisodes, all the different quality levels, you would get a few petabytes.

I implore you to do a back-of-the-envelope estimate and get to 25 petabytes.

Please take into account that I purposefully started with the highest quality level currently in use, which is ~10GB per movie. The assumption is that lower quality levels will only be a fraction of that size therefore all versions of a single movie won't be more than 20-50GB total. Additionally, many older movies are not available in the high quality formats and take up only a tenth of this space.

Also I'd like to point out that the MPAA is the Motion Picture Association of America, which is an American trade association that represents the six big Hollywood studios. So they don't represent the "rare international films".

Still, I'm just making rough estimates myself as well. I'd love it if you could come up with a possible way to explain that, say, at least half of this data could consist of MPAA represented intellectual property.

I just don't think they produced nearly enough content to warrant shutting down all the data stored in MegaUpload, even given that MegaUpload probably does store all their IP illegally, in multiple formats.

Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by nikcub on Sunday March 25, 2012 @04:05PM (#3753651)
I did, hence: "you would get a few petabytes."
Re:Storing 25 petabytes of Megaupload data costs us $9,000 a... by mbetter on Thursday March 22, 2012 @11:35PM (#3743533)
I would wager that a good percentage of the data is completely redundant.