News for hackers. Stuff that matters.
Re:Why old-school PostgreSQL is so hip again by jack9 on Monday December 11, 2017 @12:54PM (#15898752)
Kafka was useful in a project because of the semantics for what amounts to writing to file from network sockets.

Spark is a terribly inefficient solution to any known/stable data processing or analytics jobs. If you want a common format to trade with buddies, it's useful now. I expect something else will come along to replace that fad tech.

Re:Why old-school PostgreSQL is so hip again by tabacof on Monday December 11, 2017 @01:10PM (#15898921)
>Spark is a terribly inefficient solution to any known/stable data processing or analytics jobs.

Can you expand on that?

Re:Why old-school PostgreSQL is so hip again by mdekkers on Monday December 11, 2017 @03:00PM (#15899883)
Spark is a terribly inefficient solution to any known/stable data processing or analytics jobs.

You gave a typo there.

Spark is a terribly inefficient solution to any known/stable data processing or analytics jobs I have ever come across.

There, fixed that for you.

Re:Why old-school PostgreSQL is so hip again by jack9 on Thursday December 14, 2017 @07:26PM (#15928737)
I don't think that's fixed, because it's not what I assert.

Any job that is predictable, can be done faster and cheaper with some C (or Go) and ad-hoc delegation to load balanced VMs. Spark is difficult to optimize for consistent processes, poor on resource usage, and requires specialized knowledge. Just pay for someone who has done a little embedded programming and stop creating buzzword jobs because a prototype went to production without comparison.