Snowmobile was built because a pre-sales engineer sarcastically said backing up a truck full of hard drives to a customers datacenter would be the fastest way to import X PB of data. It's probably loading from a tape silo and spent 18 months at the customer site.
I’m guessing:
1. You’ve never priced out said circuits before
2. Never seen the lead times and minimum contract periods on them
3. Don’t realize in general how hard it is to actually max out circuits like that.
Shipping / freight company is generally still a preferred solution to moving very very large amounts of data even in 2020. Your own employer still ships large datasets that way too. Here’s a link from 2007:
https://royal.pingdom.com/fedex-still-faster-than-the-intern...
But from contacts I know inside Google, it’s still done regularly.
If I had 1-10 PB to move I could totally see most people using FedEx to ship JBODs around. For small transfers it makes sense, and we also have a product for this. Internally I'd use our WAN for those, which is where this now starts to make sense: Amazon does not have anywhere near the global WAN capacity that we do, nor so far have they had a good reason to have that capacity.
If you've got the global capacity to allow a customer to peer to your nearest location (and your nearest location likely isn't too far away for most of the world), fiber makes sense for large (~EB-scale, which I assume anyone with 100PB+ is well on their way to 1EB+) amounts of data. We have a product for these peerings (primarily for customers in colos): https://cloud.google.com/interconnect/docs/concepts/dedicate...
Also, when I go to: https://www.infrastructure.aws/
(annoyingly I can't link to the network) it says 100Gbps of WAN capacity around the AWS global network.
I did a quick search and wasn't able to find what it is for GCP -- do you have a link handy?
Say I have datacentre in london, Sure I could plumb in 4 100gig lines. But they are typically on a year lease and have a long lead time.
Plus, once its on the datatruck its AWS's problem.
https://cloud.google.com/transfer-appliance
Also, if you want to know an extreme edge case that can't (currently) be done any other way, consider the astronomical observatories at the South Pole.
Antarctica was the only place that came to mind, but I wasn't sure about the costs of getting a shipping container in / out.
Those are big fucking planes, so maybe you can?
In particular if you have ~100PB of data to move and you are in a location that can be reached by a 45-foot long shipping container on a truck with access to the ~350KW of power it takes to run Snowmobile, you're clearly not somewhere _completely_ inaccessible. Given that 100PB of data will cost you $400k/mo in storage costs on AWS Glacier (before the discounts that you'll obviously negotiate for), even relatively remote locations become "accessible" for 100 Gbps+ fiber or microwave connectivity, and _very_ remote locations for tens of Gbps. The Snowmobile itself is only 1 Tb/s, so if you think you're going to save time this work, consider how long it takes to move it to you and then move it to an AWS facility versus the time it takes to fill it.
I don't get where this is the right call for _any_ customers, even as a one-off. I'd love it if someone from AWS could tell me where my math is off on this.