Command-line tools can be faster than a Hadoop cluster (2014)

Re:Command-line tools can be faster than a Hadoop cluster (2... by vthriller on Thursday January 30, 2020 @07:05AM (#22190762)

I'd pick a call in the morning any time given that the cause of the call occurs rarely and the alternative is to spend a lot of time automating things with possibility of blowing things up in a much bigger way. If situation like [0] had happened to me at night, I'd happily take a time off my sleep and do manual standby server promotion (or no promotion at all) rather than spend days recovering from diverged servers that Raft kool-aid was supposed to save me from.

[0] https://github.blog/2018-10-30-oct21-post-incident-analysis/

[ Parent | on HN ]

Re:Command-line tools can be faster than a Hadoop cluster (2... by bayindirh on Thursday January 30, 2020 @08:11AM (#22191055)

I'm not against your point of view to be honest. It's a perfectly rational and pragmatic to act this way.

I'm not also advocating that "complete, complex automation" is the definitive answer to this problem. On the contrary, I advocate "incremental automation" which, solves a single problem in a single step. If well documented, it works much better and reliably in the long run & can be maintained with ease.

Quoting John Gall:

> A complex system that works is invariably found to have evolved from a simple system that worked. A complex system designed from scratch never works and cannot be patched up to make it work.

[ Parent | on HN ]