News for hackers. Stuff that matters.
Re:Amazon Kinesis Firehose – Simple and Scalable Data Ingestion by gfodor on Wednesday October 07, 2015 @12:42PM (#10347062)
Just so I'm understanding, is this a Kafka competitor?
Re:Amazon Kinesis Firehose – Simple and Scalable Data Ingestion by hatred on Wednesday October 07, 2015 @12:45PM (#10347086)
Kinesis is basically Kafka as a service. IIUC, Kinesis Firehose is just a way to ingest data into S3 buckets/Redshift and Firehose would give you the goodies like monitoring/fault tolerance etc.
Re:Amazon Kinesis Firehose – Simple and Scalable Data Ingestion by rgarcia on Wednesday October 07, 2015 @12:51PM (#10347128)
The closest thing I could compare it to would be services that make it easier to get data into Redshift or S3. E.g. segment.io's redshift product: https://segment.com/redshift.
Re:Amazon Kinesis Firehose – Simple and Scalable Data Ingestion by phillipamann on Wednesday October 07, 2015 @01:04PM (#10347250)
This looks like an AWS version of Apache Flume and Kinesis looks like an AWS version of Apache Storm. Does AWS have a Kafka equivalent i.e. a pub/sub message queue?
Re:Amazon Kinesis Firehose – Simple and Scalable Data Ingestion by mirceal on Wednesday October 07, 2015 @01:13PM (#10347314)
Kinesis != Apache Storm The easiest way to think about Kinesis is a managed queue that can remember the history for the past 24 hours.
Re:Amazon Kinesis Firehose – Simple and Scalable Data Ingestion by phillipamann on Wednesday October 07, 2015 @02:06PM (#10347751)
Ah OK. I saw that it kept state so I thought it was like Storm. I don't fully understand Storm. However, Kafka can not keep state (and neither can Flume). So Kinesis is a queue that has some state?
Re:Amazon Kinesis Firehose – Simple and Scalable Data Ingestion by cbsmith on Wednesday October 07, 2015 @01:25PM (#10347422)
Kinesis is a LOT more like Kafka than Storm.