News for hackers. Stuff that matters.

A comment on Command-line tools can be faster than a Hadoop cluster (2014). Parent comment

Re:Command-line tools can be faster than a Hadoop cluster (2... by La1n on Thursday January 30, 2020 @05:35AM (#22190393)
As someone who doesn't know a lot about this stuff, is there a way to have the base load internal and use a cloud provider for elastic load?
[ Parent | on HN ]
Re:Command-line tools can be faster than a Hadoop cluster (2... by krab on Thursday January 30, 2020 @06:48AM (#22190707)
Yes, with a caveat which is latency. For example it's hard to split a typical webapp so the application servers are far from the database. The latency kills performance.

On the other hand, for stuff like CI jobs, batch processing or anything else which doesn't depend on tight synchronization with the other location, you can mix and match.

[ Parent | on HN ]