News for hackers. Stuff that matters.
Re:AWS Ground Station by endymi0n on Sunday March 29, 2020 @03:26PM (#22721839)
This was sufficiently close in timing that I wasn't sure for a moment whether this was just an early caught April Fools.

Then again, the more I think about it, the more this makes sense. Satellite business is hard and capital intensive enough as it is, for starters in the micro-satellite business it would be absolutely prohibitive to run their own hardware just to receive those signals.

Re:AWS Ground Station by jlgaddis on Sunday March 29, 2020 @05:37PM (#22722993)
> ... I wasn't sure for a moment whether this was just an early caught April Fools.

Nope, this was actually announced [0] about 18 months ago.

---

[0]: https://aws.amazon.com/blogs/aws/aws-ground-station-ingest-a...

Re:AWS Ground Station by yongjik on Sunday March 29, 2020 @06:23PM (#22723328)
They do have some impressive "I didn't know anyone would need that!" services. I also love this one:

https://aws.amazon.com/snowmobile/

> AWS Snowmobile is an Exabyte-scale data transfer service used to move extremely large amounts of data to AWS. You can transfer up to 100PB per Snowmobile, a 45-foot long ruggedized shipping container, pulled by a semi-trailer truck. (...)

Re:AWS Ground Station by josephmosby on Monday March 30, 2020 @10:23AM (#22728241)
The real reason Snowmobile exists: to knock out potential opposition to large-scale migration from on-prem data centers into AWS.

Most of the intro decisions around moving to the cloud happen before Amazon is ever involved in the sales cycle. There are some managerial accountants and IT people getting involved to evaluate options in a process called "Evaluation of Alternatives." At some point, Amazon probably started hearing that the IT people were saying "we can't possibly move all of that data to the cloud, it would swamp our network or take five years just to finish the network transfer."

Enter Snowmobile, which cuts that conversation thread off at the knees. Amazon can go to a Fortune 100 company that is evaluating a move and honestly claim that they are prepared to move exabytes of data, physically, into the cloud. And it's not some premium feature that they're going to get charged bajillions for, it's a stock feature of AWS. (Even if it costs a lot of money)

Snowmobile isn't targeted at the average customer, it's targeted specifically at the accountants, IT architects, and management consultants evaluating the decision to move all of Fortune 100 Company X from on-prem data centers into 100% AWS. One extra hug from Amazon to let the most risk-averse person know that they have it covered, and would they please go ahead and write their 9-figure check to AWS.

Re:AWS Ground Station by phinnaeus on Sunday March 29, 2020 @06:26PM (#22723352)
They also have Snowballs, which are luggage-sized versions of the Snowmobile that can be shipped. They have a built-in e-ink display for the shipping label.
Re:AWS Ground Station by jsolson on Monday March 30, 2020 @01:35AM (#22725513)
I work on Google Cloud and have an obvious bias here, but having thought about this for a couple year now, this does not seem like a good or cost-effective way to move that much data.

In particular if you have ~100PB of data to move and you are in a location that can be reached by a 45-foot long shipping container on a truck with access to the ~350KW of power it takes to run Snowmobile, you're clearly not somewhere _completely_ inaccessible. Given that 100PB of data will cost you $400k/mo in storage costs on AWS Glacier (before the discounts that you'll obviously negotiate for), even relatively remote locations become "accessible" for 100 Gbps+ fiber or microwave connectivity, and _very_ remote locations for tens of Gbps. The Snowmobile itself is only 1 Tb/s, so if you think you're going to save time this work, consider how long it takes to move it to you and then move it to an AWS facility versus the time it takes to fill it.

I don't get where this is the right call for _any_ customers, even as a one-off. I'd love it if someone from AWS could tell me where my math is off on this.

Re:AWS Ground Station by mike_d on Monday March 30, 2020 @02:58AM (#22725812)
There is your first mistake: thinking the customer wants to solve the problem in a a good or cost-effective way.

Snowmobile was built because a pre-sales engineer sarcastically said backing up a truck full of hard drives to a customers datacenter would be the fastest way to import X PB of data. It's probably loading from a tape silo and spent 18 months at the customer site.

Re:AWS Ground Station by milesward on Monday March 30, 2020 @10:06AM (#22728114)
No, it was built because a solutions architect sat next to a film producer on a plane and talked about how to solve for his unique needs.
Re:AWS Ground Station by jsolson on Monday March 30, 2020 @11:21AM (#22728707)
Miles, I can't tell if you're messing with me or just stating what actually happened :)
Re:AWS Ground Station by snowwrestler on Monday March 30, 2020 @02:00AM (#22725615)
It reads to me like you're saying: if you're going to spend $400k/month on storage cost, why not pay for a network buildout too? I don't think that allocating X per month for op-ex implies that you also have Y amount of money to spend on cap-ex... especially if you don't own the location. 350kw of power is just another trailer to pull up.
Re:AWS Ground Station by jsolson on Monday March 30, 2020 @11:00AM (#22728533)
I am assuming that anyone who managed to accumulate 100 PB of data (or close enough to make this viable) is still accumulating data at a solid clip, or likely has a lot _more_ than just 100 PB of data
Re:AWS Ground Station by jsjohnst on Monday March 30, 2020 @07:43AM (#22727177)
> even relatively remote locations become "accessible" for 100 Gbps+ fiber or microwave connectivity, and _very_ remote locations for tens of Gbps.

I’m guessing:

1. You’ve never priced out said circuits before

2. Never seen the lead times and minimum contract periods on them

3. Don’t realize in general how hard it is to actually max out circuits like that.

Shipping / freight company is generally still a preferred solution to moving very very large amounts of data even in 2020. Your own employer still ships large datasets that way too. Here’s a link from 2007:

https://royal.pingdom.com/fedex-still-faster-than-the-intern...

But from contacts I know inside Google, it’s still done regularly.

Re:AWS Ground Station by jsolson on Monday March 30, 2020 @11:15AM (#22728652)
Pretty good idea on #3 (and for much much much larger links), and a decent idea for #1.

If I had 1-10 PB to move I could totally see most people using FedEx to ship JBODs around. For small transfers it makes sense, and we also have a product for this. Internally I'd use our WAN for those, which is where this now starts to make sense: Amazon does not have anywhere near the global WAN capacity that we do, nor so far have they had a good reason to have that capacity.

If you've got the global capacity to allow a customer to peer to your nearest location (and your nearest location likely isn't too far away for most of the world), fiber makes sense for large (~EB-scale, which I assume anyone with 100PB+ is well on their way to 1EB+) amounts of data. We have a product for these peerings (primarily for customers in colos): https://cloud.google.com/interconnect/docs/concepts/dedicate...

Re:AWS Ground Station by wildfire on Monday March 30, 2020 @12:06PM (#22729100)
That product looks exactly like AWS Direct Connect

Also, when I go to: https://www.infrastructure.aws/

(annoyingly I can't link to the network) it says 100Gbps of WAN capacity around the AWS global network.

I did a quick search and wasn't able to find what it is for GCP -- do you have a link handy?

Re:AWS Ground Station by KaiserPro on Monday March 30, 2020 @02:58AM (#22725811)
its about timing.

Say I have datacentre in london, Sure I could plumb in 4 100gig lines. But they are typically on a year lease and have a long lead time.

Plus, once its on the datatruck its AWS's problem.

Re:AWS Ground Station by greglindahl on Monday March 30, 2020 @09:48AM (#22727957)
I guess you didn't notice that Google Cloud has a thing that competes with Snowball?

https://cloud.google.com/transfer-appliance

Also, if you want to know an extreme edge case that can't (currently) be done any other way, consider the astronomical observatories at the South Pole.

Re:AWS Ground Station by jsolson on Monday March 30, 2020 @10:55AM (#22728502)
I said Snowmobile doesn't make sense. Snowball makes total sense. The economics are entirely different.

Antarctica was the only place that came to mind, but I wasn't sure about the costs of getting a shipping container in / out.

Re:AWS Ground Station by greglindahl on Monday March 30, 2020 @11:00AM (#22728538)
For the south pole, they use C-130s, and not standard shipping containers. You can see the little ones that they use in the photo at the bottom of https://www.nsf.gov/geo/opp/support/lc130.jsp
Re:AWS Ground Station by jsolson on Monday March 30, 2020 @11:17AM (#22728679)
Right, but Snowmobile is packaged as a shipping container because it has a small datacenter inside, so unless you can fit the assembled 45ft container in the plane, I don't think this works?

Those are big fucking planes, so maybe you can?

Re:AWS Ground Station by a012 on Monday March 30, 2020 @04:56AM (#22726288)
Re:AWS Ground Station by giaour on Sunday March 29, 2020 @11:30PM (#22724977)
I think the same customer (Digital Globe, an earth imagery LEO satellite operator) was on stage at both announcements. Snowmobile for getting PB of data from their ground network into AWS and Ground Station to get it there directly from space
Re:AWS Ground Station by closeparen on Sunday March 29, 2020 @07:18PM (#22723655)
I wanted a small-scale version of this for my personal photos, back when I realized that uploading a few hundred GB on my 5mbps down/0.5mbps up residential cable connection was going to take weeks.

(Ended up doing it from university, where I had symmetric 100mbit in my dorm room).

Re:AWS Ground Station by tim-- on Sunday March 29, 2020 @09:17PM (#22724352)
They also have a service where you can ship them a USB hard drive.

https://aws.amazon.com/blogs/aws/send-us-that-data/

Re:AWS Ground Station by paranoidrobot on Sunday March 29, 2020 @07:56PM (#22723874)
That's what the snowballs are for.
Re:AWS Ground Station by holmberd on Sunday March 29, 2020 @08:21PM (#22724035)
Without a doubt.
Re:AWS Ground Station by 2J0 on Sunday March 29, 2020 @11:47PM (#22725049)
This is my view of Renaissance if Internet cafés!
Re:AWS Ground Station by partiallypro on Monday March 30, 2020 @12:38AM (#22725294)
Microsoft has a similar service called Databox, wouldn't be surprised if GCS has something like this as well

https://azure.microsoft.com/en-us/services/databox/

Re:AWS Ground Station by smueller1234 on Monday March 30, 2020 @04:23AM (#22726178)
GCP Transfer Appliance: https://cloud.google.com/transfer-appliance

(I work at Google, don't work on that product.)

Re:AWS Ground Station by wildfire on Monday March 30, 2020 @12:12PM (#22729182)
I actually used this personally (Jan 2019)

You'll get supplied (at least) two SSDs.

With instructions for how to use in both Windows and Linux.

Unfortunately even though it was "GA", it appears that they never really actually tested using it in Linux.

I submitted (and they were merged) a number of documentation bugfixes related to Linux.

Two firmware updates later, one bricked disk, one which failed to verify the copied data -- and 9 months of time all down the drain.

This reason is why I will never use Azure. It wasn't the bugs and device failures that was the problem. Just the sheer work in having to teach Azures' support staff about their own product (after fighting to get them to record the support case -- you normally can't raise one if you don't pay).

Why did I pick Azure for this?

Because (at the time) both GCP and AWS catered for 100Gb+ volumes. And we were (and remain) around 50Gb.

I haven't re-evaluated to see if either GCP or AWS have better options now.

Re:AWS Ground Station by rockostrich on Sunday March 29, 2020 @11:25PM (#22724957)
The announcement for this at re:Invent was them literally driving an 18-wheeler onto the stage: https://www.youtube.com/watch?v=8vQmTZTq7nw
Re:AWS Ground Station by lonelappde on Sunday March 29, 2020 @09:16PM (#22724350)
Now I'm staring at my kitchen table visualizing a 100^3 pile of 1TB hard drives.
Re:AWS Ground Station by akiselev on Sunday March 29, 2020 @05:15PM (#22722824)
I don't get how this helps. For startups/individuals, AWS eliminated all capex expenditures except for a single user's computer, which can be had for orders of magnitude cheaper than server hardware, literally. The cost of a cheap but powerful enough laptop or tablet plus keyboard is under $200 now.

Unless you literally do everything by hand (which is a niche, but a tiny one), the cubesat is still going to cost at least 10-50k and the launch 100-400k. In the grand scheme of things, it's not the huge improvement that the rest of AWS infrastructure was.

I think this could be a huge deal for students and academics though. It's not uncommon for companies to give away free secondary/tertiary slots (at least in my experience pre-SpaceX) because the logistics infrastructure is expensive to keep around and they can write off costs that they normally would have to eat. Even if this only shaves 10% off the cost of a sat project, that's a lot of extra money for aerospace clusters like LA, Cal Poly, MIT, etc. and might be enough to start hitting more economies of scale leading to a snowball of development.

Between university machine shops and subsidized labor, Ground Station, and low cost launches once SpaceX volume increases, it might become feasible for student groups to pull off launches for $50-100k total which would be well within the realm of rotary clubs, small-to-medium educational grants, and university budgets.

Re:AWS Ground Station by wongarsu on Sunday March 29, 2020 @05:47PM (#22723065)
> AWS eliminated all capex expenditures

You were always able to just rent servers running in someone else's data center.

AWS as we know it launched in 2006, [1] is Hetzner's homepage from 2001 offering dedicated servers for $125/month + $125 setup fee. By 2005 [2] you can get a AMD Athlon XP 3000+ with 1 GB RAM and 350GB traffic for 39€/month.

1: https://web.archive.org/web/20010813053224/http://www.hetzne...

2: https://web.archive.org/web/20050507034045/http://www.hetzne...

Re:AWS Ground Station by closeparen on Sunday March 29, 2020 @07:05PM (#22723574)
Hetzner's pricing is a reflection of the generally lower price level in Europe. Dedicated server providers with US datacenters do exist, but their pricing is much closer to Amazon's.
Re:AWS Ground Station by namibj on Monday March 30, 2020 @02:40AM (#22725756)
Why are they so expensive? German electricity is ~2x as expensive as the cheaper US regions.
Re:AWS Ground Station by moooo99 on Monday March 30, 2020 @05:29AM (#22726411)
A lot of the cheap Hetzner boxes are using consumer hardware. The EX line starting at 40€/month are using 6th generation i7 CPUs. The AX line is using 3rd gen Ryzen CPUs. If you want actual server-grade hardware, you'll end up with around 90€/month, other hosters are more expensive. I'd assume this would explain some of the price difference
Re:AWS Ground Station by namibj on Tuesday March 31, 2020 @11:27AM (#22738431)
Maybe. But honestly AMD server HW is <50% more expensive than their non-server hardware. Also their consumer chips do offer ECC support, and you don't need anything else really for those applications.
Re:AWS Ground Station by dexcs on Monday March 30, 2020 @04:21AM (#22726168)
They use consumer hardware, that's why they are so cheap.
Re:AWS Ground Station by d_silin on Sunday March 29, 2020 @05:20PM (#22722865)
You can get your code on the satellite, effectively getting it for your own use for as little as $0. Right now. This is what ESA OPS-SAT mission is all about.
Re:AWS Ground Station by lainga on Sunday March 29, 2020 @08:04PM (#22723923)
Huh! Some interesting perspective that it seems so outlandish. I've already seen Ground Station in the AWS console, all by itself in its own category, for the past few months, and thought it was widely-known.
Re:AWS Ground Station by justizin on Sunday March 29, 2020 @08:27PM (#22724066)
pretty sure it's been there for years.
Re:AWS Ground Station by dodobirdlord on Sunday March 29, 2020 @08:32PM (#22724116)
I believe it was announced in November 2018.
Re:AWS Ground Station by SkyMarshal on Sunday March 29, 2020 @03:59PM (#22722162)
What’s unclear to me is, if any company can run their own satellite fleet, even micro ones, can they really not afford to run their own ground stations too?

What’s the target customer profile of this service exactly?

Re:AWS Ground Station by mirashii on Sunday March 29, 2020 @04:08PM (#22722232)
I worked at a company that with a fleet of microsatellites that also built and managed our own network of groundstations. The costs of groundstations can definitely add up. Scouting for locations with good RF properties takes a lot of long flights, weird dealings with customs (RF equipment is questioned heavily). Then you have to find a site to host it, maybe ask them to beef up their security, construction to support your hardware once it gets above a certain size (dishes and radomes for S and X band comms), network connections and redundant network connections, and a team of people to manage and coordinate all of it. It's certainly its own undertaking and could easily be outsourced to a service with the right specs. Whether AWS's offering here will rise to meet that is yet to be seen.
Re:AWS Ground Station by bradknowles on Sunday March 29, 2020 @08:06PM (#22723938)
I did a six month consulting gig for Raytheon on their GPS OCX project — building the next-generation ground control systems to manage the current fleet of GPS satellites, plus the next-generation fleet of satellites.

The rule at Raytheon was that Lockheed got the easy end of the job — they just had to design, build, and launch the new fleet. It was Raytheon who got the really hard end of the job, because they had to be able to seamlessly manage both the new and old fleets.

I would submit that designing, building, and operating the ground control systems remains the hardest part of the job, even if you don’t have a legacy fleet of satellites that you have to manage on top of the new fleet.

Think about it — when you’re doing the operations side of the house, you have to be perfect, all the time. That one time you aren’t perfect and your opsec fails, you lose. The other guys just have to be right once, and they can keep trying and trying and trying indefinitely, until they get that one time they win. That’s definitely the harder job.

Re:AWS Ground Station by closeparen on Sunday March 29, 2020 @07:02PM (#22723561)
>maybe ask them to beef up their security

What's the threat model for a ground station? Interception? Sabotage? Hardware theft? Can you even sell these things on eBay?

Re:AWS Ground Station by xenophonf on Sunday March 29, 2020 @09:03PM (#22724286)
Satellite navigation is a key strategic asset, as is any system that carries national and trans-national communications. Imagine being able to interfere with a navy's navigation, maybe not enough to stop them from getting somewhere but definitely enough to slow them down. Or imagine being able to change the position of a communications satellite, a device that is basically just dumb microwave relay---and microwave, I'll remind you, is highly directional. Or what about getting access to the ground station's network traffic? I'll bet that even when it's encrypted, there's still useful signals intelligence to be gleaned, and when it isn't encrypted (or encrypted badly), boy howdy.

Satellites and their attendant infrastructure cost billions of dollars to deploy and maintain. They are incredibly valuable targets, making it worth an attacker's while to penetrate them. This is way beyond simple vandalism or ransomware.

Re:AWS Ground Station by tracker1 on Monday March 30, 2020 @06:58AM (#22726903)
Don't really know any specifics, but I'd imagine being able to use the compromised satellites as simple rams against military satellites could be a significant risk, depending on the size of the fleet... even if not destroying a target.

Not to mention just plain destruction of bringing down a fleet of satellites.

Re:AWS Ground Station by nradov on Monday March 30, 2020 @09:27AM (#22727824)
Very few commercial satellites carry enough maneuvering fuel to ram any military satellite. And none of them are equipped with the sensors needed for an intercept.
Re:AWS Ground Station by closeparen on Sunday March 29, 2020 @09:21PM (#22724378)
I would expect ground stations that important to be on military bases, not random locations that a private company is scouting. No?
Re:AWS Ground Station by kube-system on Sunday March 29, 2020 @10:02PM (#22724551)
A ground station can also point at things it's not supposed to:

https://en.wikipedia.org/wiki/Captain_Midnight_broadcast_sig...

Re:AWS Ground Station by paxys on Sunday March 29, 2020 @04:16PM (#22722303)
It's the same argument as - if a company can run a multi-billion dollar operation, can they not afford their own datacenters? They can, but AWS just makes things easier and often cheaper.

The core competency of a business you describe is building, launching and maintaining satellites. On-ground network infrastructure, computing hardware, data processing, machine learning etc. is something AWS is a lot more familiar with.

Re:AWS Ground Station by kylek on Sunday March 29, 2020 @04:44PM (#22722553)
Running your own flock is far from the norm. The target is likely the media/broadcast industry.
Re:AWS Ground Station by thoraway1010 on Sunday March 29, 2020 @06:23PM (#22723326)
I came to say this. Some folks just have intermittant needs. I want to a remote hookup for Z minutes at x time from y sat.
Re:AWS Ground Station by d_silin on Sunday March 29, 2020 @04:29PM (#22722413)
I would say "it depends", when it comes to cost. You can build your own grown station for UHF/VHF bands at under $1000.

S-band and beyond will cost you more, but a fully-featured VHF/UHF/S-band one from a proper vendor will be under $100K.

X-band, yeah... But not that many cubesats have X-band transceivers anyway.

Re:AWS Ground Station by bitminer on Sunday March 29, 2020 @04:35PM (#22722472)
This is the classic "make or buy" decision. You can rent by the minute, or own your own.

What the Amazon website doesn't cover is:

- download guarantee. They rent you the antenna, they don't commit to a successful reception (and consequent refund if it fails)

- link status report (needed for a positive confirmation of successful reception.) This is basically a series of SNR measurements

- competition with other users of the same antenna: first-come first served? Maybe your spacecraft needs more storage to save the downlink data if the Amazon antenna is busy.

And of course they don't talk about the competition.

Re:AWS Ground Station by d_silin on Sunday March 29, 2020 @04:38PM (#22722497)
Yes, I agree. Comes with probably the same caveats as all other Amazon services.
Re:AWS Ground Station by namibj on Monday March 30, 2020 @02:47AM (#22725783)
X band reception isn't expensive. LNB + dish is a combination that handles a large part of the X band for <100$. I'm not sure how expensive an X-band uplink is, but I think some satellite internet providers used them, in which case they are also likely <1000$.

And it's normally better to just have more redundancy instead of higher individual uptime, at least as long as space, weight and power are not an issue (i.e., on the ground).