News for hackers. Stuff that matters.

A comment on Apache Flink. Parent comment

Re:Apache Flink by mxmxm on Wednesday January 30, 2019 @05:56AM (#19034120)
Not quite. All of these are open-source projects but they are very different in many aspects:

* Apache Flink

Sophisticated stream processing framework with focus on robustness (managed memory) and correctness (exactly-once semantics)

* Apache Flume

Tailored towards log data.

* Apache Storm

First stream processing framework. Legacy.

* Apache Samza

Only used at LinkedIn. Tight to Hadoop's YARN.

* Apache Spark

Only great in batch processing.

* Apache Apex

Dead project. Tight to Hadoop's YARN.

* Apache Kafka

A distributed message queue with simple stream processing built on top via the Confluent Platform.

[ Parent | on HN ]
Re:Apache Flink by dankohn1 on Wednesday January 30, 2019 @06:11AM (#19034183)
Nice list. There are also non-Apache projects like NATS, hosted by CNCF.

Here are the 19 streaming and messaging projects and products that CNCF is tracking: https://landscape.cncf.io/category=streaming-messaging&forma...

[ Parent | on HN ]
Re:Apache Flink by michaelmior on Wednesday January 30, 2019 @08:09AM (#19034703)
> Only used at LinkedIn.

And Intuit, Uber, Netflix, VMWare, ....

https://cwiki.apache.org/confluence/display/SAMZA/Powered+By

[ Parent | on HN ]