Re:What every software engineer should know about Apache Kafka
by devin on Sunday May 17, 2020 @02:45AM
(#23210105)
I worked on a project recently which had Kafka in it. Our first order of business was to completely remove it. I would bet good money that many projects on Kafka would benefit tremendously from simply removing it. It's wildly unnecessary in 7/10 situations I see it employed.
[ Parent
| on HN ]
Re:What every software engineer should know about Apache Kafka
by qlm on Sunday May 17, 2020 @05:06AM
(#23210712)
What was it replaced with?
Re:What every software engineer should know about Apache Kafka
by StreamBright on Sunday May 17, 2020 @12:16PM
(#23212934)
Not the guy who posted above but I think I have relevant experience. After going through different options for message queuing we have decided that using S3 and object will be our best option for many reasons. Some of those reasons:
- durable
- cheap
- scalable
- we do not need to read messages in a strict order
- using S3's API is super easy
- no operations overhead
- no compute resources (for the queue part)
After doing it some time I think that I was drinking too much cool-aid with streaming services like Kinesis and Kafka and failed to see how easy it is to implement a simple analytics even service using purely S3.