News for hackers. Stuff that matters.
Re:Kafka in a Nutshell by hakann on Friday September 25, 2015 @05:13PM (#10280723)
Is AWS SNS/SQS equivalent to Kafka? And what are the differences, advantages/disadvantages of either one?
Re:Kafka in a Nutshell by Cieplak on Friday September 25, 2015 @05:25PM (#10280790)
Kinesis is the AWS alternative to Kafka, minus some features.
Re:Kafka in a Nutshell by power on Friday September 25, 2015 @05:40PM (#10280871)
Kinesis is for streaming computations. It's closer to Apache Storm (which typically uses Kafka) than Kafka.
Re:Kafka in a Nutshell by fizx on Friday September 25, 2015 @08:29PM (#10281550)
You might be thinking of Simple Workflow Service, which is closer to Storm. Grandparent had it right.
Re:Kafka in a Nutshell by serialpreneur on Friday September 25, 2015 @07:22PM (#10281329)
Agree with Cieplak. Kinesis is very Kafka-esque, with less flexibility (which makes sense for a managed service).

Producer/Consumer semantics are pretty similar. Partitions in Kafka are Shards in Kinesis terminology.

One big difference is retention period in Kinesis has a hard limit of 24 hours (no way to request increase on this limit).

Kinesis IMO is easier to use being a managed service. I have performed a Kafka to Kinesis migration & have found Kinesis easier to use. Plus, AWS Lambda makes consuming Kinesis a breeze (if your usecase suits it).