News for hackers. Stuff that matters.
Re:Containers and Distributed Systems: Where They Came from ... by kuschku on Thursday October 12, 2017 @03:23AM (#15456257)
Indeed, the trend is clear, but for now, nothing has changed.

Google's implementation is not very helpful to all those companies, individuals, NGOs, and governments that have to follow privacy laws, HIPAA, etc though, because Google's implementation isn't open source, and these entities can't use Google Cloud. Or don't want to.

Until we get an open source solution for this, SMP machines will be useful.

And even then, you save money by having less and larger machines in your cluster than just having tiny ones. Larger machines means your overhead is reduced.

Re:Containers and Distributed Systems: Where They Came from ... by numbsafari on Thursday October 12, 2017 @07:17AM (#15457142)
Uhhhh... most orgs that run HIPAA workloads do so slavishly on Windows and EPIC, neither of which are famously what most would consider open source.
Re:Containers and Distributed Systems: Where They Came from ... by kuschku on Thursday October 12, 2017 @07:36AM (#15457223)
You’re right, the real distinction is on-premises vs off-premises, I should have made that more clear (although free software implies on-premises being possible)
Re:Containers and Distributed Systems: Where They Came from ... by numbsafari on Thursday October 12, 2017 @08:38AM (#15457506)
I’m still confused... most orgs running HIPAA workloads are still doing so on prem, AND using very much non-free software.

Google, and Amazon, and MS, undergo extensive third-party audits and people can, and do, run HIPAA workloads there.

I’m not sure what distinction you are trying to draw.

Re:Containers and Distributed Systems: Where They Came from ... by kuschku on Thursday October 12, 2017 @09:12AM (#15457673)
The distinction is that companies that require HIPAA workloads aren’t going to upload their entire dataset into Google Cloud Spanner, which is not available as on-prem version, and which isn’t HIPAA certified.

So either we need an on-prem version of Cloud Spanner, Cloud Spanner needs to be HIPAA certified, certified to match German privacy laws, etc, or Cloud Spanner can’t serve these situations.

Re:Containers and Distributed Systems: Where They Came from ... by jabl on Thursday October 12, 2017 @04:16AM (#15456438)
There's cockroachdb which is roughly open source spanner you can deploy on your own systems.
Re:Containers and Distributed Systems: Where They Came from ... by kuschku on Thursday October 12, 2017 @04:27AM (#15456485)
Which has still horrible join performance, and several other tradeoffs. (see https://www.cockroachlabs.com/blog/cockroachdbs-first-join/)

Maybe in a year, or two. But not today.

Re:Containers and Distributed Systems: Where They Came from ... by zzzcpan on Thursday October 12, 2017 @08:03AM (#15457332)
Spanner has a lot of tradeoffs too, I'm not sure what do you see as problematic in Cockroach, joins are good enough. The biggest tradeoffs are inherent to strongly consistent distributed systems. Even precise clocks and fast networks won't help as much as you might think. You still have to accept vastly different latencies and performance than in traditional single-node RDBMSs.
Re:Containers and Distributed Systems: Where They Came from ... by kuschku on Thursday October 12, 2017 @11:44AM (#15458794)
If I run several servers in the same rack, with a local private 10Gbps network, with CockroachDB, running on spinning HDDs, I expect to get the same (or better) throughput as with a single PGSQL instance, and a similar latency. (When accessing it from another server, via the public internet).

That’s not always the case, though.

Re:Containers and Distributed Systems: Where They Came from ... by phaemon on Thursday October 12, 2017 @07:32AM (#15457207)
That blog post is from a year ago. And since Cockroach DB 1.0 was only released in May this year, it's a bit misleading to link to that post as though it was the current state of the sofware.
Re:Containers and Distributed Systems: Where They Came from ... by kuschku on Thursday October 12, 2017 @07:34AM (#15457213)
That blog post is referenced in their FAQ today, under the topic of what it can't do right now. Sorry if I misunderstood the situation, I’d appreciate any updated links.

See: https://www.cockroachlabs.com/docs/stable/frequently-asked-q...

Re:Containers and Distributed Systems: Where They Came from ... by phaemon on Friday October 13, 2017 @05:50AM (#15464274)
Ah, my apologies then. It's their fault for not updating the FAQ and you can hardly be blamed for quoting from it!

There was an update to that 6 months later: https://www.cockroachlabs.com/blog/better-sql-joins-in-cockr...

I'd assume they've made even more improvements since, so they really should update their docs.