News for hackers. Stuff that matters.
Re:Why Distributed Systems Are Hard to Develop – and How to ... by hajak on Thursday March 28, 2019 @02:29PM (#19515107)
Can you really make a tool that works for different platforms? Won't the abstractions always leak?
Re:Why Distributed Systems Are Hard to Develop – and How to ... by edvald on Thursday March 28, 2019 @02:38PM (#19515187)
It's always a balancing act. Make the abstractions really stiff, and you can optimize heavily for that context. Too loose, and it becomes opaque and hard to reason about. And messy.

That's why we spent so much time working out the plugin mechanism, and figuring out what's native to the core framework. Terraform, for example, nails the infrastructure stuff quite well and strikes a good balance there, so we used that as a reference. But we added specific primitives for developing the application layer, and made that pluggable through a similar approach. Providers figure out the _how_, but the relationships in the graph are predictable.

Case in point, we now have a handful of different ways to deploy code. There's a Helm module type, which is very flexible but carries all the complexity and manual effort you need to make Helm charts. On the other side there's OpenFaaS, which is very constrained in features, but super easy to get going. So you can pick and choose depending on the level of abstraction you need.

Plus you'll soon be able to make your own, so you can tailor the abstractions to your needs, but keep the consistency of a single core dev tool.

Re:Why Distributed Systems Are Hard to Develop – and How to ... by hajak on Thursday March 28, 2019 @03:06PM (#19515450)
Thanks for the response.