News for hackers. Stuff that matters.
Re:Netflix Billing Migration to AWS by hetfeld on Tuesday June 21, 2016 @05:43PM (#11949658)
Dropped Oracle, using MySQL. Why not use PostgreSQL instead?
Re:Netflix Billing Migration to AWS by lapitopi on Tuesday June 21, 2016 @08:53PM (#11950811)
I work on the Netflix Billing Team.

PostgreSQL was indeed a very attractive option, but we wanted to keep a path to Aurora open. When we were working on the migration, Aurora was still in beta, so instead of going to Aurora directly, we decided run our own MySQL instances on EC2.

Re:Netflix Billing Migration to AWS by Annatar on Thursday June 23, 2016 @04:21AM (#11959551)
Does "Aurora" fix the inherently broken SQL and integrity constraint mishandling associated with MySQL?

Which security models does "Aurora" offer, for instance, are you able to use OS authentication like in Oracle? What about PKI on SmartCards?

Re:Netflix Billing Migration to AWS by philliphaydon on Wednesday June 22, 2016 @01:26AM (#11951742)
Why would you go to RDS with such large amounts of data when AWS do not provide ability to get data out easily. If you moved away from AWS in the future for what ever reason your data is more or less stuck in AWS.
Re:Netflix Billing Migration to AWS by jon-wood on Wednesday June 22, 2016 @03:07AM (#11952057)
Amazon released their data migration service a while back, which allows you to transfer data in just about anyway you might want to, they'll migrate data between different RDS engines (MySQL to Postgres for example), and to databases outside AWS. They even support near real-time replication to database servers outside AWS, so you could hypothetically replicate your RDS instances to a fail over environment with another provider. There's very little risk of your data being locked in now.

[1] https://aws.amazon.com/dms/?nc2=h_mo

Re:Netflix Billing Migration to AWS by philliphaydon on Wednesday June 22, 2016 @06:25AM (#11952684)
Unless you use SQL Server. The dms service is basically useless with sqlserver. We can't get our 200gb do out of AWS. And any method that works without dms takes about 40 hours.
Re:Netflix Billing Migration to AWS by toomuchtodo on Wednesday June 22, 2016 @01:56PM (#11955727)
Can you replicate to a slave outside of RDS and then perform a replica promotion during scheduled maintenance?
Re:Netflix Billing Migration to AWS by lilbobbytables on Tuesday June 21, 2016 @11:14PM (#11951325)
Ahhh, now it makes sense. Thanks for answering.
Re:Netflix Billing Migration to AWS by eterm on Tuesday June 21, 2016 @06:52PM (#11950110)
Is there a version of poe's law for hacker news / slashdot?

A large company describes their very real efforts and shares their experience and knowledge, and the first comment is "Why not use <preferred thing> instead?".

Re:Netflix Billing Migration to AWS by Rodeoclash on Tuesday June 21, 2016 @07:06PM (#11950197)
Because knowing how they worked through the decision to come to a conclusion on using a particular product is valuable.

Postgres is usually the first choice for applications like this so knowing why they chose something else over that could influence others that need to make a similar decision.

Re:Netflix Billing Migration to AWS by thinkingkong on Tuesday June 21, 2016 @08:01PM (#11950507)
When you say usually you probably mean "currently, usually" or "in the last x years usually".

Netflix has super smart people. They arent just picking random tools off the shelf and implementing things without constraints for the sake of it.

Re:Netflix Billing Migration to AWS by angersock on Tuesday June 21, 2016 @08:45PM (#11950761)
Right, which is why asking how they came to that decision (instead of using a DB dating back over three decades of development) is useful and reasonable.
Re:Netflix Billing Migration to AWS by otterley on Wednesday June 22, 2016 @02:04AM (#11951861)
> Postgres is usually the first choice for applications like this

Do you have any data to substantiate this claim?

Re:Netflix Billing Migration to AWS by cpollard on Tuesday June 21, 2016 @07:48PM (#11950426)
I know regarding HIPAA, Aurora isn't supported but mySQL is. Maybe there's a reason why it's not HIPAA compliant that made it unusable for Netflix? And cost?
Re:Netflix Billing Migration to AWS by singlow on Tuesday June 21, 2016 @09:40PM (#11951006)
What aspects of HIPAA does Aurora cause problems for which wouldn't be a problem for other storage engines? The Aurora engine RDS product supports all of the normal MySQL access controls, SSL in transit and at-rest encryption for the data, snapshots and backups.
Re:Netflix Billing Migration to AWS by wmfiv on Tuesday June 21, 2016 @10:58PM (#11951267)
I don't believe it's a technical problem. It just hasn't completed the internal AWS process for HIPAA certification to be added to their BAA. Postgres is in the same boat.
Re:Netflix Billing Migration to AWS by ams6110 on Tuesday June 21, 2016 @10:03PM (#11951078)
Where is the intersection between HIPPA and a back-office customer billing system?
Re:Netflix Billing Migration to AWS by justinhj on Tuesday June 21, 2016 @06:55PM (#11950130)
Assuming MySQL meets their needs there's no hugely compelling reason to choose PostgreSQL over MySQL.