News for hackers. Stuff that matters.
Re:Canva saves millions annually in Amazon S3 costs by electroly on Monday June 19, 2023 @11:40AM (#36392351)
Tip for anyone looking to spend seven-figure or more sums on one-time egress: Direct Connect egress is $0.02/GB. Rent a rack at a Direct Connect facility and get as many 10G fiber Direct Connects as you need, with corresponding flat rate 10G Internet ports with HE/Cogent/whatever transit provider. If you're going to be spending millions on egress, you could just hire someone to set this up for you. With that kind of spend you'd be crazy to pay the full $0.09/GB.
Re:Canva saves millions annually in Amazon S3 costs by fakedang on Monday June 19, 2023 @11:49AM (#36392451)
Plot twist : Canva blogged this so someone could tell them some solution like this, without them having to hire the guy. :)
Re:Canva saves millions annually in Amazon S3 costs by tough on Monday June 19, 2023 @12:22PM (#36392879)
There's this law on the internet or SO or whatever where if you put the wrong answer in a post.

Someone else in the comments will correct you with the correct answer.

This in effect.

Re:Canva saves millions annually in Amazon S3 costs by lbotos on Monday June 19, 2023 @01:20PM (#36393785)
Re:Canva saves millions annually in Amazon S3 costs by leon1717 on Monday June 19, 2023 @03:52PM (#36395770)
Cunningham is cunning!!!
Re:Canva saves millions annually in Amazon S3 costs by grogenaut on Monday June 19, 2023 @03:50PM (#36395749)
This isn't just the internet. I've used this at work several times to break stalemates. I've come into many stalled projects where people are arguing over trivial details or blue skying on requirements. 1-2 hours and a 7 page design doc later I'll have everyone review what I know is an 80% answer. Pretty much every time they'll all start attacking my design, pointing out minor issues and then I have them. They've agreed to my overall design and are into details.

Same if someone is calling out all of the general problems with solving a problem but not providing answers where you can't get them to bite.

Re:Canva saves millions annually in Amazon S3 costs by dehrmann on Monday June 19, 2023 @12:46PM (#36393208)
I worked at a place that did an AWS to GCP migration. I didn't look into the details, but they used a provider that basically gave them a fat, dedicated fiber link between the two (they picked the same GCP region). It was good enough that requests could have data cross clouds. It was expensive to set up, but it saved on egress costs and opened up options for migrating services.
Re:Canva saves millions annually in Amazon S3 costs by electroly on Monday June 19, 2023 @12:53PM (#36393348)
I believe the relevant GCP product is "Dedicated Interconnect" and for Azure it's "ExpressRoute Direct" but don't quote me on that; I only know AWS. In my example you can swap out the Internet port for one of those cloud interconnects and go straight from AWS to your new cloud. That's certainly what that provider was doing. I bet there's lots of good money in facilitating those migrations using this relatively simple technique.
Re:Canva saves millions annually in Amazon S3 costs by gurchik on Monday June 19, 2023 @04:49PM (#36396269)
Cloudflare R2 also has a tool in beta that provides an incremental migration from S3. As users request files using your R2 URLs, Cloudflare automatically migrates the files from S3 to R2 on request. Depending on your user's request patterns this may be a way to migrate everything without paying any additional cost. If you have a lot of files that are rarely accessed then they will be slow to migrate, but because they are rarely accessed your S3 costs could be significantly reduced by using different storage classes anyway. Eventually you will have a small enough number of infrequently accessed files remaining in S3 that the additional cost to migrate them all in one go can make financial sense.
Re:Canva saves millions annually in Amazon S3 costs by vkaku on Monday June 19, 2023 @05:16PM (#36396586)
Awesome. I just wrote about it above. Thanks for sharing!