News for hackers. Stuff that matters.
Re:Downloading a file regularly - how hard can it be? by kogir on Monday April 09, 2012 @01:22PM (#3818012)
I would just sign it, stick it on S3, and forget it. Did I miss why that wasn't considered?
Re:Downloading a file regularly - how hard can it be? by nitrox on Monday April 09, 2012 @05:25PM (#3819314)
It is too expensive. 1TB of bandwidth costs about $120. A project like adblock plus will be consuming about 3 - 4 TB a month which will add up to around $450 a month.

Adblock list subscriptions are maintained and hosted by individual people who do at their spare time. They mostly pay for the servers out of their pockets. As one of the co-author of popular adblock list, I wouldn't want to break my bank to pay for S3 hosting. Our current solutions works out and when we reach our bandwidth limit, we could just simply buy addition TB of bandwidth at a much cheaper price than S3.

Btw, i just made a rough calculation using AWS simple monthly calculator. So correct me if I am wrong about S3 pricing.

Re:Downloading a file regularly - how hard can it be? by tedunangst on Monday April 09, 2012 @06:47PM (#3819684)
Terabytes per month? That's insane. That's a million users (I can believe) downloading a megabyte (I can't quite believe). It appears my patterns.ini file is 600K, or about 150K compressed, so if I download it 30/5 = 6 times a month, that's... a megabyte. Wow.
Re:Downloading a file regularly - how hard can it be? by tripzilch on Tuesday April 10, 2012 @02:48AM (#3821068)
Wow, that suggestion elsewhere in the thread, to serve diffs instead seems rather important now :)
Re:Downloading a file regularly - how hard can it be? by forgotusername on Monday April 09, 2012 @01:39PM (#3818150)
While this workaround has merit, it doesn't actually solve the underlying problem. I guess even Amazon will eventually pick up the phone and ask you to stop sending them weekly bandwidth spikes when the figures involved get large enough (I've personally seen this with another well known PaaS provider).
Re:Downloading a file regularly - how hard can it be? by moe on Monday April 09, 2012 @02:04PM (#3818319)
I guess even Amazon will eventually pick up the phone

Why would they?

You'd have to push dozens of GBit/s to even appear on their radar. The only time they'll call you is when they can't charge your CC anymore (a sustained 1 GBit/s will set you back $1000/day at their current rate).

Re:Downloading a file regularly - how hard can it be? by drzaiusapelord on Monday April 09, 2012 @04:01PM (#3818923)
Yep, they'll happily bill you. I imagine the budget adblock plus has is pretty small and, you know, can't be subsidized with ads.
Re:Downloading a file regularly - how hard can it be? by pbhjpbhj on Tuesday April 10, 2012 @06:38AM (#3821552)
Didnt they alter it to allow some ads through by default; or was that all reverted?