Re:Apache Pulsar is an open-source distributed pub-sub messa...
by addisonj on Thursday January 02, 2020 @02:37PM
(#21938896)
Biggest thing is that we find ourselves needing to retain this data for more than initial delivery and also for use cases where we want to use the data more like a log and need ordering guarantees. It isn't just our current SQS use cases, it is being able to have one tech that does SQS like stuff and Kinesis like stuff in one place
[ Parent
| on HN ]
Re:Apache Pulsar is an open-source distributed pub-sub messa...
by tybit on Thursday January 02, 2020 @04:38PM
(#21940155)
When we ran into a similar use case we went with writing to S3 and using S3 SNS notifications and consumers could subscribe their SQS queues to that.
Having said that, assuming Pulsar has a similar feature to Kafkas log compaction I can definitely see the appeal!
Also the fact that SQS Fifo doesn’t integrate with this setup is super annoying.
Edit: Log compaction not key compaction