News for hackers. Stuff that matters.
Re:What every software engineer should know about Apache Kafka by peterhunt on Saturday May 16, 2020 @05:59PM (#23207566)
I don't think it's that simple unless I misunderstand how GCP Pubsub works. I don't think GCP PubSub will give you deterministic delivery order within a partition the way Kafka will: https://cloud.google.com/pubsub/docs/ordering
Re:What every software engineer should know about Apache Kafka by batter on Saturday May 16, 2020 @06:21PM (#23207678)
We have Kafka and GCP pubsub. Kafka is the way to go for us. In terms of reliability, performance, load, etc.
Re:What every software engineer should know about Apache Kafka by skyde on Saturday May 16, 2020 @08:34PM (#23208376)
Are you saying GCP pubsub have bad reliability? I never used it but would be surprised if it was down for several hours each weak or would just drop your data.

I would love to know your experience

Re:What every software engineer should know about Apache Kafka by batter on Saturday May 16, 2020 @09:20PM (#23208626)
One of the teams was complaining about behavior on load. Now another team will migrate that flow to Kafka. Another team was complaining about reliability/speed. I think eventually they stopped relying on that.