News for hackers. Stuff that matters.
Re:Scaling Shopify's Black Friday Live Map: An Apache Flink ... by pvtmert on Thursday December 16, 2021 @01:25PM (#29581798)
Many people abuses Redis as pub/sub queue. I wonder how is Redis topology though. Becuase in a native redis-cluster, keys are hashed. So pub/sub still writes to the same instance if the key is same.

And if the Redis is the enterprise edition or the open-source one. For OSS edition, there needs to be a gateway for HTTP API. More often than not, I saw the client implementation being faulty rather than the Redis itself.

Shopify has a huge scale though, probably smaller issues wound up and become problems...

Re:Scaling Shopify's Black Friday Live Map: An Apache Flink ... by bantmen on Thursday December 16, 2021 @01:54PM (#29582212)
Redis was being used as a message bus here, so messages were being queued up and delivered in order using sorted sets. Overall, the performance issue was not the fault of Redis but rather how it was being used. The proposal (at the bottom of the post) does not suffer from these issues.