News for hackers. Stuff that matters.

A comment on Don't use Hadoop when your data isn't that big (2013). Parent comment

Re:Don't use Hadoop when your data isn't that big (2013) by Spooky23 on Tuesday May 23, 2017 @12:46PM (#14402785)
One bunch of yahoos I ran into was building a Hadoop cluster to do some bullshit to user and PC configuration data before loading it into a big helpdesk system like Remedy or ServiceNow.

They were 6 months in and made no progress other than building 30 servers. I wrote an awk script to process the CSVs and did the rest in Excel in about 30 minutes. I had an intern automate the process with a perl script, which took 3-4 days! :)

The program management was very upset, mostly because they looked like a pack of clowns.

[ Parent | on HN ]
Re:Don't use Hadoop when your data isn't that big (2013) by unixhero on Tuesday May 23, 2017 @01:09PM (#14403010)
As a client I would have been comically outraged
[ Parent | on HN ]
Re:Don't use Hadoop when your data isn't that big (2013) by ktRolster on Tuesday May 23, 2017 @02:46PM (#14404006)
The program management was very upset, mostly because they looked like a pack of clowns.

How did they respond to that? Any kind of retaliation?

[ Parent | on HN ]
Re:Don't use Hadoop when your data isn't that big (2013) by Spooky23 on Tuesday May 23, 2017 @06:35PM (#14405992)
Not happy!

Pulling a move like that requires extensive, pre-positioned aircover.

[ Parent | on HN ]
Re:Don't use Hadoop when your data isn't that big (2013) by lucidguppy on Tuesday May 23, 2017 @07:44PM (#14406461)
Why not just output "HADOOP CLUSTER OUTPUT" at the top of the awk script...
[ Parent | on HN ]