News for hackers. Stuff that matters.
Re:Rubygems.org AWS bill for Feb 2014 [pdf] by TylerE on Tuesday March 04, 2014 @10:21PM (#7345061)
Bandwidth on DO is (worst case), $20.48/TB, so their 17TB usage would cost $348/month. A far cry from $5,000.
Re:Rubygems.org AWS bill for Feb 2014 [pdf] by ukd1 on Tuesday March 04, 2014 @10:38PM (#7345124)
You miss the point; bandwidth from a single source != CDN. Hosting without a CDN would be extremely slow for people that were far (hops) away from DO. CDN's solve this, and other issues.
Re:Rubygems.org AWS bill for Feb 2014 [pdf] by TylerE on Tuesday March 04, 2014 @10:55PM (#7345169)
How much does that really matter? Even going to the otherside of the world is only 200ms or so, and the time taken to run rubygems is hardly a factor in just about any workflow I can imagine.

Think of it another way - what would be more valuble - RubyGems hosted on CDN, or RubyGems on DO and give a couple of grants for talent hackers to work on their gems fulltime for a few months. (ala GSoC)

Even if you ARE concerned about latency, have one download server in the US (E.g. DO), one in Europe (e.g. Hetzner) and one in SE Asia (Not sure who's cheap and good-ish there), and you'd still be a 1/4 the cost of AWS bandwidth or less.

Re:Rubygems.org AWS bill for Feb 2014 [pdf] by evanphx on Tuesday March 04, 2014 @11:23PM (#7345263)
Person who pays the bill here. Latency does matter and we're paying an additional $1.5k new in Feb to improve european latency. RubyCentral can afford to spend the money to improve latency issues, so we do!
Re:Rubygems.org AWS bill for Feb 2014 [pdf] by ksec on Wednesday March 05, 2014 @12:05AM (#7345417)
Really, why would that be the case? I mean the difference in Latency.

A self set up Linode CDN with all six location Tokyo, JP London, UK Newark, NJ Atlanta, GA Dallas, TX Fremont, CA

Would have provided 48TB of Pooled bandwidth at a very decent speed and cost around $480. Linode's Network are great, much better then DO. I am not sure if it match CloudFront, which isn't exactly the fastest CDN anyway.

Re:Rubygems.org AWS bill for Feb 2014 [pdf] by sitkack on Wednesday March 05, 2014 @12:50AM (#7345544)
Great info. Did you use rsync and push data out in a tree? How did you handle DNS? Did you do 302 requests to closer servers (by some metric) ?
Re:Rubygems.org AWS bill for Feb 2014 [pdf] by driverdan on Wednesday March 05, 2014 @12:38AM (#7345501)
Having volunteers spend countless hours to setup and maintain their own CDN is a preposterous idea.
Re:Rubygems.org AWS bill for Feb 2014 [pdf] by ksec on Wednesday March 05, 2014 @02:08AM (#7345776)
Here

http://psyphi.net/blog/2013/12/content-delivery-network-cdn-...

I have 10 fingers, so that is definitely not "countless" hours of work. And No, Maintenance are minimal or non existent. You could even get smaller VPS behind each node balancer as HA. Since Linode VPS ( Unlike DO ) are deployed on physically different hardware.

While i say it is fair enough to use AWS because money doesn't matter, i thought there are definitely some better alternative for the same price( if you really cared about latency ) or cheaper options.

Re:Rubygems.org AWS bill for Feb 2014 [pdf] by NKCSS on Wednesday March 05, 2014 @03:54AM (#7346044)
Loved the blog posting :)
Re:Rubygems.org AWS bill for Feb 2014 [pdf] by TylerE on Tuesday March 04, 2014 @11:31PM (#7345285)
Fair enough!
Re:Rubygems.org AWS bill for Feb 2014 [pdf] by _delirium on Wednesday March 05, 2014 @04:08AM (#7346083)
That's been my impression so far with repositories where you configure a mirror explicitly, like Debian or CPAN. I used to be diligent about doing "the right thing" and switching out the default (usually something in the U.S.) for a Danish or nearby mirror. But I've stopped caring much because it doesn't really seem to make any perceptible difference. If I remember to, I still will switch it just so I don't unnecessarily waste intercontinental infrastructure, but it doesn't make much difference to my own experience.