News for hackers. Stuff that matters.
Re:Command-line tools can be faster than a Hadoop cluster (2... by iagovar on Thursday January 30, 2020 @12:57PM (#22193517)
Is the stack too complicated? I mean from a layman perspective id doesn't look like fancy tech, am I wrong?
Re:Command-line tools can be faster than a Hadoop cluster (2... by leonardteo on Thursday January 30, 2020 @02:01PM (#22194250)
It depends on who is working on it. :) For devs who are comfortable with bare/close-to-metal clusters and networking, it's really not complex (and why over the years it's just not been an issue for me to just hack on it on the side). But for other devs, just the context switching from working on application domains becomes an overhead you can't ignore. Then when you factor in all the other overheads of assigning a "team" to it which includes scrum events, refinement, just talking about it ends up driving the cost up.

It is a little bit more complex now - e.g. I added on-the-fly image resizing routines. But the core concepts of caching on multiple pops, being able the purge, etc. no it is not fancy tech by any stretch of the imagination.