News for hackers. Stuff that matters.
Re:Migrating from AWS to Fly.io by tommoor on Tuesday January 03, 2023 @08:44PM (#34240836)
Fly is great. I know the Fly team has an aversion to it but I really just wish they would hire some database folks and take on managed Postgres. I'm already running 8+ apps on there and it would be the peace of mind needed to move the rest across… one day.
Re:Migrating from AWS to Fly.io by joao on Tuesday January 03, 2023 @09:36PM (#34241260)
Would love this also.

The best option I could find was using Digital Ocean Managed Databases. The cheapest costs $15, but you can host multiple databases with good insights and backups. You can choose where you host it, and place it close to the region where youre Fly.io apps are, with low latency.

Only caveat is there isn't an easy way to automatically update the IPs whitelist of the database, to support the Fly builder and deployed app(s).

Re:Migrating from AWS to Fly.io by garganzol on Tuesday January 03, 2023 @09:44PM (#34241320)
The best value option I've seen so far is Azure SQL Server databases. Not exactly Postgres, but it's only $5/month and works wonders.
Re:Migrating from AWS to Fly.io by memset on Tuesday January 03, 2023 @10:33PM (#34241690)
I recently switched to fly.io + crunchybridge. Crunchy is super easy to set up and their cheap plan ($10/month) is quite performant too.
Re:Migrating from AWS to Fly.io by atonse on Tuesday January 03, 2023 @09:18PM (#34241119)
The lack of “managed” Postgres is the only reason we haven’t moved 100% to fly.

The idea of having to do my own upgrades by updating the docker container scares me.

I have literally never run a stateful service off docker and don’t see the point, thanks to AWS.

RDS has been extremely stable and boring. Maybe it’s out together by similar duct tape under the hood but it’s been incredibly solid for nearly a decade across multiple database stacks.

Re:Migrating from AWS to Fly.io by garganzol on Tuesday January 03, 2023 @09:40PM (#34241296)
What stops you from using a managed database from a provider who specializes in it?

If Fly builds it, it will create another Goliath who tries to eat everything.

Re:Migrating from AWS to Fly.io by minxomat on Tuesday January 03, 2023 @10:02PM (#34241450)
Not really. I see fly competing with Workers for smaller services, and with KV and D1, managed edge DBs are so easy it’s hard to live without them. Very different use case from a traditional managed DB - because it’s either all scaling and running in fly or it isn’t.
Re:Migrating from AWS to Fly.io by Spivak on Tuesday January 03, 2023 @10:04PM (#34241463)
Network posture? I can’t imagine trying to put the public internet in between my app servers and db.
Re:Migrating from AWS to Fly.io by paulv on Wednesday January 04, 2023 @02:01AM (#34242881)
Doesn't fly.io have tailscale integration?
Re:Migrating from AWS to Fly.io by estsauver on Wednesday January 04, 2023 @03:20AM (#34243313)
You still need to go over a public network (as opposed to a network inside a data center.)
Re:Migrating from AWS to Fly.io by arianvanp on Wednesday January 04, 2023 @04:49AM (#34243814)
what makes a network private?
Re:Migrating from AWS to Fly.io by csunbird on Wednesday January 04, 2023 @07:18AM (#34244673)
The point the OP wanted to make was:

Servers sitting less than 1km to each other tend to have lesser latency between them, compared to servers that could be anywhere on the public internet.

Re:Migrating from AWS to Fly.io by atonse on Wednesday January 04, 2023 @11:49AM (#34247946)
Ah because I am interpreting it more at the logical level and about them venturing out into unknown territories (the packets are traversing routers I do not control), rather than just latency. Since others have mentioned that latencies are very low if you locate in the same region.

But if you have a zero-trust architecture and everything communicates over wireguard, then technically public or private won't matter right?

Not saying public/private IPs don't matter – since almost all the servers would still only have private IPs.

In a sense this is more like VPC peering.

Re:Migrating from AWS to Fly.io by krab on Thursday January 05, 2023 @07:16AM (#34258696)
With IPv6, you can have all public IPs (the same as early days of IPv4). However, if you have apps that are tightly coupled and often with strict latency requirements such as Web <-> DB, then it's better to communicate only over private links. You can control latency and you have better reaction time when something breaks down. That is in addition to security concerns.

I remember a failure of one transatlantic line that was used for one direction of packets we were sending between EU and US. I spent a night on a phone trying to convince AWS and our other datacenter operator to work around the problem by changing their routing and to push the backbone operator to fix the problem - we didn't have any relationship with the backbone of course.

You don't want such disruption to happen in a core part of your app. These disruptions can also be intermittent and "random" and you have no way to fix.

Re:Migrating from AWS to Fly.io by zbentley on Wednesday January 04, 2023 @09:55AM (#34246159)
An RFC 1918 address range and an implementation that does not transmit data over infrastructure not owned by the network operator.

I think I know what you're getting at, and if I'm right, this isn't really a subjective or squishy subject.

Re:Migrating from AWS to Fly.io by dehrmann on Tuesday January 03, 2023 @11:19PM (#34242010)
I wonder if we're moving to an unbundling phase of the cloud.

The only reason I think we might not be is the selling point is less vendor lock-in, not something managed significantly better. For the most part, the major cloud providers have mature, feature rich product offerings for common use cases like DB, distributed queues, running services, load balancers, etc.

Re:Migrating from AWS to Fly.io by mrkurt on Tuesday January 03, 2023 @11:26PM (#34242037)
I hope we're unbundling! RDS is fine, but it doesn't really offer me (as an app dev ... sometimes) much. PlanetScale is a better MySQL: https://planetscale.com/blog/introducing-planetscale-boost
Re:Migrating from AWS to Fly.io by atonse on Wednesday January 04, 2023 @11:51AM (#34247971)
Are you guys looking at a partner program where a lot of the managed postgres companies could also provide managed postgres but on top of your infra? (like they do with GCP/AWS/etc)
Re:Migrating from AWS to Fly.io by nine_k on Wednesday January 04, 2023 @12:31AM (#34242368)
> What stops you from using a managed database from a provider who specializes in it?

A lack of integrated security and authorization? Should be solvable though.

The expense of external traffic? The latency to a DB in a different datacenter?

Re:Migrating from AWS to Fly.io by cebu on Wednesday January 04, 2023 @07:07AM (#34244601)
That latency was the deal breaker for me. Kind of defeats having your app running on metal near your customers if they're in Dallas and the DB's in Ohio
Re:Migrating from AWS to Fly.io by ec109685 on Wednesday January 04, 2023 @03:35AM (#34243386)
This is an advantage of the big public clouds. Any SaaS you could want is deployed into the same region as your application, so it's essentially co-located and on the same playing field as one of the native public cloud services.

With Fly.io (at least today), this isn't as straightforward given your favorite database is likely not deployed there.

Re:Migrating from AWS to Fly.io by garganzol on Wednesday January 04, 2023 @08:50AM (#34245461)
Even at the minimal scale, one is going to have quite a few app instances all over the world sooner or later. In such setting, a notion of regional proximity of any kind quickly becomes irrelevant.

Higher database round-trip times are fixed by using database stored procedures instead of making multitudes of tiny compound SQL queries.

Re:Migrating from AWS to Fly.io by ec109685 on Wednesday January 04, 2023 @05:21PM (#34252735)
Not everything can be represented by a single database query. Often there is mixing involved using multiple sources, which break down the one query for all results pattern, and thus encourage co-locating the database near the tier making the db requests.
Re:Migrating from AWS to Fly.io by danielvaughn on Saturday January 14, 2023 @05:59AM (#34379224)
I’m planning on moving to fly.io, and I’m exploring cloud-based databases. Specifically Planetscale and CockroachDB.
Re:Migrating from AWS to Fly.io by samlambert on Saturday January 14, 2023 @10:49AM (#34381176)
Re:Migrating from AWS to Fly.io by mrkurt on Tuesday January 03, 2023 @09:17PM (#34241109)
I'm not completely averse (we've done this before!), it's just not how I think the world should work. If we hold out, and the future Fly cloud has a better-than-RDS Postgres option, it will be worth it. If we build our own managed Postgres, no one better is going to bring their stuff to our platform. Same with MySQL.
Re:Migrating from AWS to Fly.io by subleq on Tuesday January 03, 2023 @09:37PM (#34241269)
I'd trust a first-party managed postgres built by fly more than a third-party one.
Re:Migrating from AWS to Fly.io by belmont_sup on Wednesday January 04, 2023 @12:08AM (#34242246)
I like their strategy of outsourcing what they’re not best at to the best. They partnered with upstash, and now they’ve got a new feature almost immediately. Sure there’s a lot of vetting, but wrapping products is common.

I’d be happy if they can wrap Neon’s serverless postgres service into their networks somehow.

Re:Migrating from AWS to Fly.io by nikita on Wednesday January 04, 2023 @12:21AM (#34242321)
Neon CEO here.

We are working on becoming first party service on several major problems now. We will be happy to provide this for Fly. Kurt and I have been chatting.

Fly wants cross region replication which is coming soon. Once it's there we can integrate.

With that Neon is still on AWS and can be close to Fly, but not run on Fly servers. It's relatively straightforward for us to run on Fly, but the S3 part will still be Amazon.

Re:Migrating from AWS to Fly.io by robertlagrant on Wednesday January 04, 2023 @05:02AM (#34243890)
This sounds like a match made in heaven.
Re:Migrating from AWS to Fly.io by belmont_sup on Wednesday January 04, 2023 @11:36AM (#34247739)
Fantastic, nikita! Hope all goes well.
Re:Migrating from AWS to Fly.io by ignoramous on Tuesday January 03, 2023 @10:33PM (#34241692)
> I'm not completely averse (we've done this before!)

For those out-of-loop: https://news.ycombinator.com/item?id=7382151