News for hackers. Stuff that matters.
Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by yndoendo on Sunday January 18, 2026 @01:07PM (#46670355)
I recently had to parse 500MB to 2GB daily log files into analytical information for sales. Quick and dirty, the application would of needed 64GB RAM and work laptop only has 48GB RAM. After taking time cleaning it up, it was using under 1GB of RAM and worked faster by only retaining records in RAM if need be between each day.

It is not about what you are doing, it is always about how you do it.

This was the same with doing OCR analysis of assembly and production manuals. Quick and dirty, it would of took over 24 hours of processing time, after moving to semaphores with parallelization it took less than two hours to process all the information.

Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by maest on Sunday January 18, 2026 @06:54PM (#46673448)
> It is not about what you are doing, it is always about how you do it.

It saddens me to see how the LinkedIn slop style is expanding to other platforms

Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by moooo99 on Monday January 19, 2026 @03:31AM (#46676339)
There is nothing slop style about this. Things often times being more about how you do them is one of the core characteristics of engineering
Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by maest on Monday January 19, 2026 @05:07PM (#46685168)
"It's not about X, it's about Y" is a very common (and tired) LinkedIn trope.