Re:Command-line Tools can be 235x Faster than your Hadoop Cl...
by grenran on Monday March 07, 2022 @11:14PM
(#30596378)
Walking to the store is faster than catching a plane
[ Parent
| on HN ]
Re:Command-line Tools can be 235x Faster than your Hadoop Cl...
by yakshaving_jgt on Tuesday March 08, 2022 @01:10AM
(#30596951)
I believe the point of the article is that people seem to have a poor intuition for when itβs appropriate to choose the plane over walking.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl...
by ricardobeat on Tuesday March 08, 2022 @03:03AM
(#30597624)
I assume this is mocking the article as obvious, but it starts from someone using Hadoop to process 1.75GB of data.
The default advice is that you should catch a plane to go anywhere, and the author is showing why you should walk.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl...
by kaba0 on Tuesday March 08, 2022 @07:11AM
(#30599038)
1.75 GB of data is going to the supermarket down a street with a plane still. Hell, perhaps just to the fridge. It is nowhere near big data when a 10 years old low-end phone can hold it in memory.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl...
by ricardobeat on Tuesday March 08, 2022 @07:21AM
(#30599102)
Yes, that's the point I was trying to make, could have phrased it better.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl...
by throwaway984393 on Tuesday March 08, 2022 @01:22AM
(#30597006)
But it's hard to get investors to give you hundreds of millions of dollars to buy tennis shoes, easier to get it for a Gulfstream
Re:Command-line Tools can be 235x Faster than your Hadoop Cl...
by rovr138 on Monday March 07, 2022 @11:47PM
(#30596546)
But if you're going to keep adding destinations and going to them, an airport is a better idea.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl...
by Cthulhu_ on Tuesday March 08, 2022 @04:28AM
(#30598128)
Depends if it's just another store within walking distance. I think the gist of the GP comment was that they use a big tool for a small job. Many small jobs don't make the big tool any more useful.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl...
by rovr138 on Tuesday March 08, 2022 @09:29AM
(#30600229)
Of course, there are uses.
But if you have many jobs that you have to maintain and run, standardizing the tool and workflow is really helpful.