News for hackers. Stuff that matters.

A comment on Apache Storm 1.0 released. Parent comment

Re:Apache Storm 1.0 released by throwaway-anon on Tuesday April 12, 2016 @04:27PM (#11483270)
Actually that's not true. Have a look at the airflow project by AirBnB.

https://github.com/airbnb/airflow

[ Parent | on HN ]
Re:Apache Storm 1.0 released by squeaky-clean on Tuesday April 12, 2016 @04:54PM (#11483494)
Doesn't seem like it can handle processing on real-time streams of data. They don't really seem comparable.

From the readme:

"Airflow is not a data streaming solution. Tasks do not move data from one to the other (though tasks can exchange metadata!). Airflow is not in the Spark Streaming or Storm space, it is more comparable to Oozie or Azkaban."

[ Parent | on HN ]
Re:Apache Storm 1.0 released by throwaway-anon on Tuesday April 12, 2016 @08:11PM (#11484686)
I was replying to a comment not saying airflow is capable of stream processing.

> Not for multinode analytics of huge data sets.

Airflow does this just fine with celery.

[ Parent | on HN ]
Re:Apache Storm 1.0 released by brianwawok on Tuesday April 12, 2016 @05:38PM (#11483800)
That doesn't really seem the same at all.
[ Parent | on HN ]