News for hackers. Stuff that matters.
Re:Designing Our Serverless Engine: From Kubernetes to Nomad... by gravypod on Thursday July 08, 2021 @04:38PM (#27777308)
Don't use services that lock you in. Instead use a layer that abstracts that. In the past I think I have heard of people using Presto for similar operations and that can be self hosted. I would never build a company on top of tech I can only get from one place. Regardless of the layer in the stack.

If it's abstracted behind an agreed upon industry standard protocol (MySQL, pg, mongo connections or S3/NFS storage, etc)? Sure. If it's special sauce? No way.

My $Job-1 is migrating the stack I setup from Azure to GCP and it's been fairly painless from what I heard (only taking a few weeks to make an account, test, then move everything over).

Re:Designing Our Serverless Engine: From Kubernetes to Nomad... by dmitriid on Thursday July 08, 2021 @05:10PM (#27777656)
> Don't use services that lock you in.

Why, if they bring value?

> Instead use a layer that abstracts that.

How can I "abstract" BigQuery?

> If it's abstracted behind an agreed upon industry standard protocol (MySQL, pg, mongo connections or S3/NFS storage, etc)?

This still doesn't answer the question of "can be implemented within kube for at-cost prices."

BigQuery is amazing at processing enormous amounts of data at fraction of time and cost it would take, say, MySQL to process the same data. How can I "abstract it away" and "implement it at cost with kube".

Even if it's purely standard stuff like PubSubs, or Apache Beam, there are value-added options that are hard to get from other providers (or implement yourself): anything from monitoring to management to scaling to...

I'm not to crazy about vendor lock-ins myself, but "abstract everything away and you can easily move over if needed" is largely a myth.