Re:Apache Kafka Goes 1.0
by zbentley on Wednesday November 01, 2017 @11:54AM
(#15602434)
You probably already know this, but obligatory reminder for others: Kafka's exactly-once delivery is not the same as exactly-once execution of an arbitrary workload. E1 mode is incredibly convenient, but it doesn't solve the tricky parts of, for example, hitting an external ACH to process a credit card payment. What if the external request times out? Fails silently? Fails loudly? Exactly-once delivery can help develop solutions in this area, but it doesn't eliminate this problem domain.
[ Parent
| on HN ]
Re:Apache Kafka Goes 1.0
by chicagobuss on Wednesday November 01, 2017 @12:13PM
(#15602673)
Of course, the key to any successful implementation of end-to-end exactly-once processing lies in the fact that you USE the kstreams APIs - including all semantics around "consumption is completed up to offset X"