News for hackers. Stuff that matters.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by grenran on Monday March 07, 2022 @11:14PM (#30596378)
Walking to the store is faster than catching a plane
Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by yakshaving_jgt on Tuesday March 08, 2022 @01:10AM (#30596951)
I believe the point of the article is that people seem to have a poor intuition for when it’s appropriate to choose the plane over walking.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by ricardobeat on Tuesday March 08, 2022 @03:03AM (#30597624)
I assume this is mocking the article as obvious, but it starts from someone using Hadoop to process 1.75GB of data.

The default advice is that you should catch a plane to go anywhere, and the author is showing why you should walk.

Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by kaba0 on Tuesday March 08, 2022 @07:11AM (#30599038)
1.75 GB of data is going to the supermarket down a street with a plane still. Hell, perhaps just to the fridge. It is nowhere near big data when a 10 years old low-end phone can hold it in memory.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by ricardobeat on Tuesday March 08, 2022 @07:21AM (#30599102)
Yes, that's the point I was trying to make, could have phrased it better.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by throwaway984393 on Tuesday March 08, 2022 @01:22AM (#30597006)
But it's hard to get investors to give you hundreds of millions of dollars to buy tennis shoes, easier to get it for a Gulfstream
Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by rovr138 on Monday March 07, 2022 @11:47PM (#30596546)
But if you're going to keep adding destinations and going to them, an airport is a better idea.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by Cthulhu_ on Tuesday March 08, 2022 @04:28AM (#30598128)
Depends if it's just another store within walking distance. I think the gist of the GP comment was that they use a big tool for a small job. Many small jobs don't make the big tool any more useful.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by rovr138 on Tuesday March 08, 2022 @09:29AM (#30600229)
Of course, there are uses.

But if you have many jobs that you have to maintain and run, standardizing the tool and workflow is really helpful.

Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by mellavora on Tuesday March 08, 2022 @04:47AM (#30598214)
might depend on the distance between destinations
Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by rovr138 on Tuesday March 08, 2022 @09:30AM (#30600238)
Fine. Maybe a bus or taxi service.

But standardizing helps and hadoop and other tools provides that.