News for hackers. Stuff that matters.
Re:Gitlab's Journey from Azure to GCP by qaq on Thursday May 02, 2019 @09:22PM (#19814631)
Not sure why you are getting down-voted not having to pay your primary competitor for services obviously had influence on this decision.
Re:Gitlab's Journey from Azure to GCP by detaro on Friday May 03, 2019 @07:41AM (#19817474)
The migration decision publicly announced months before Microsoft announced they'd buy GitHub?
Re:Gitlab's Journey from Azure to GCP by earenndil on Thursday May 02, 2019 @10:31PM (#19815003)
Netflix uses aws, even though amazon has amazon prime video. They don't seem to have no inclination to move.
Re:Gitlab's Journey from Azure to GCP by nopzor on Thursday May 02, 2019 @10:38PM (#19815034)
netflix pays aws for a very small and non strategic part of their infra. they dont move bits for videos to their users via aws. that would be insane.
Re:Gitlab's Journey from Azure to GCP by scurvy on Thursday May 02, 2019 @10:56PM (#19815124)
Netflix also arbitrages compute and encode across all major clouds depending on spot pricing. They treat the commodity...like a commodity.
Re:Gitlab's Journey from Azure to GCP by lawnchair_larry on Friday May 03, 2019 @12:20AM (#19815498)
Since netflix knows they will always be encoding, why would they pay for cloud provider overhead at all? It would seem to be far cheaper to have a dedicated fleet.
Re:Gitlab's Journey from Azure to GCP by tgsovlerkhgsel on Friday May 03, 2019 @06:17PM (#19822761)
Because buying cheap surplus capacity (spot instances) is likely cheaper than running your own (Amazon has a reason to sell them at any value above the marginal cost of running stuff on them, which is basically power).

They might have a dedicated fleet for some capacity. They might also have a less predictable encoding load (e.g. not be sure how much content they will acquire), or able to make trade-offs (encoding is expensive today? let's do a fast encode and wait until spot instances are cheap with the better one).

They might also be buying for different prices/conditions than what you and I see on the web site.

Re:Gitlab's Journey from Azure to GCP by paxys on Friday May 03, 2019 @06:56AM (#19817218)
The fact that not even the largest and most compute-intensive software companies manage their own servers now should really end the cloud computing cost argument at his point.
Re:Gitlab's Journey from Azure to GCP by dfrage on Friday May 03, 2019 @08:59AM (#19817983)
Netflix has long been open about the fact that their costs for content dwarf their IT costs, and encoding is a bursty CPU demand that perfectly fits cloud economics.

Note I'm not including their networking costs to get to the last mile, where they place a lot of their own boxes in ISP facilities pretty close to users, that would be about the same however they were doing core IT.

Re:Gitlab's Journey from Azure to GCP by paulryanrogers on Friday May 03, 2019 @07:22AM (#19817357)
Is that true for all such companies?

IME cloud _can_ easily be more expensive and more work than bare metal, in house or colocated. If course it depends upon the workload and the tools/resources available to manage it. Even with clouds there is still server management to do.

Re:Gitlab's Journey from Azure to GCP by paxys on Friday May 03, 2019 @07:38AM (#19817454)
More expensive - maybe, depending on how good you are at managing runaway costs.

More work - definitely not. No matter how hard managing your AWS workflows is, bare metal will always be all that same work plus everything else related to hardware, cooling, power management, ISP and more.

Re:Gitlab's Journey from Azure to GCP by apple4ever on Friday May 03, 2019 @01:46PM (#19820547)
But you make one tradeoff for another.

Sure you have "hardware, cooling, power management, ISP and more", but that's all easy, especially compared to managing AWS workflows.

Re:Gitlab's Journey from Azure to GCP by magicalhippo on Friday May 03, 2019 @03:43AM (#19816363)
I imagine their encoding load is quite variable. If they get access to a new catalog, they have to encode a huge amount of new movies and shows.
Re:Gitlab's Journey from Azure to GCP by cobookman on Friday May 03, 2019 @09:44AM (#19818358)
At their scale, the overhead isn't as high.

I've personally discounts ranging upwards of 90% for certain services and cloud vendors.

Re:Gitlab's Journey from Azure to GCP by dmitriid on Friday May 03, 2019 @01:33AM (#19815830)
At Netflix scale it’s probably cheaper to leverage cloud solutions than to maintain (build, equip, set up, maintain, upate, upgrade) their own data center.
Re:Gitlab's Journey from Azure to GCP by wongarsu on Friday May 03, 2019 @05:51AM (#19816915)
If your load is fairly constant, maintaining your own servers is cheaper from the moment where you need two physical servers. And even at Netflix scale "maintain their own datacenter" might mean renting a few racks in a data center of your choice.

The arguments for cloud look different: services offered by the cloud providers, higher flexibility, no capex (though at small scale you can rent and at Netflix scale capex is presumably not an issue) or better scaling in highly variable loads.

Netflix encoding servers probably have very variable load since releases vary depending on season (like the flood of films for Christmas).

Re:Gitlab's Journey from Azure to GCP by dmitriid on Friday May 03, 2019 @05:58AM (#19816943)
I'v e found that "your own servers" vs. "rent a cloud" are a bit weird as a company grows. First one is cheaper, then the other, then the first one again, then the other again, it continues like this a few times.

At one point it's quite possible that a combination of the two is the cheaper option.

And yes, you're completely right, load variability plays a huge role in all this.

Re:Gitlab's Journey from Azure to GCP by chx on Friday May 03, 2019 @06:40AM (#19817129)
That is very odd and doesn't mesh with my experience at all. Usually the server cost is linear with growth (more or less) so if the per unit cost is fixed (more or less) then how on earth would such a swap occur.
Re:Gitlab's Journey from Azure to GCP by dmitriid on Friday May 03, 2019 @07:52AM (#19817530)
Depends on the size. When operating your own servers, you need to recreate all that cloud providers do for you:

- maintain the physical machines

- build or rent data centers

- have people to operate, maintain, upgrade the machines

- set up, build, maintain, update, upgrade infrastructure for your projects to work on your machines

All these costs are not insignificant when you need more and more machines. And as it was mentioned above, they don't do well when demand is variable: when you no longer need as many machines, you can't just decommission them. When demand spikes, you can't install new servers instantly.

Re:Gitlab's Journey from Azure to GCP by AlphaSite on Friday May 03, 2019 @05:03PM (#19822253)
They’d why you do hybrid, baseline on prem.
Re:Gitlab's Journey from Azure to GCP by dmitriid on Saturday May 04, 2019 @05:57AM (#19825486)
Hybrid approach brings its own problems: your software and your infra has to work on your own servers and in the cloud, which is a harder feat to pull off than it seems.
Re:Gitlab's Journey from Azure to GCP by odensc on Thursday May 02, 2019 @11:49PM (#19815362)
Yeah, don't they colo directly with ISPs for their video CDN?
Re:Gitlab's Journey from Azure to GCP by philjohn on Friday May 03, 2019 @06:07AM (#19816991)
Not quite - they provide what is essentially an edge cache.