Re:Alleged leak of more than 5M Gmail accounts
by bostik on Wednesday September 10, 2014 @02:49AM
(#8295250)
Wget and grep would be more likely to be used - but in answer to your question: yes, in a case like this.
Let's do some quick back-of-the-envelope math. 5M addresses, with very few longer than 25 characters. Let's say the average is around 17 characters. 17 * 5 * 10^6 = 35 * 10 ^7 = 3.5 * 10^8 bytes, or 350MB. Text generally compresses to 1/8 space with zlib, so the amount to transfer would be about 44MB, at most. Serving the list as xz compressed file could probably cut the size down to below 40MB.
In the age of 100MB youtube videos, that doesn't sound like much to me.
Let's do some quick back-of-the-envelope math. 5M addresses, with very few longer than 25 characters. Let's say the average is around 17 characters. 17 * 5 * 10^6 = 35 * 10 ^7 = 3.5 * 10^8 bytes, or 350MB. Text generally compresses to 1/8 space with zlib, so the amount to transfer would be about 44MB, at most. Serving the list as xz compressed file could probably cut the size down to below 40MB.
In the age of 100MB youtube videos, that doesn't sound like much to me.