News for hackers. Stuff that matters.
Re:The Big Little Guide to Message Queues by thezorg on Monday January 29, 2024 @07:27PM (#39184740)
Poor [Cloud Tasks](https://cloud.google.com/tasks), they're the actual GCP message queue, but everyone forgets they exist and use Pub/Sub instead.

What's funny is Pub/Sub is a fundamentally different model from message queues: queues are normally tightly coupled, meaning you enqueue a message to be processed by a specific system. Pub/Sub on the other hand is fundamentally loosely coupled: the publisher doesn't care who (if anyone) gets the message.

(I've heard "orchestration" vs "choreography" to describe this dichotomy, but I can't say I'm a fan of the jargon.)

Re:The Big Little Guide to Message Queues by candiddevmike on Monday January 29, 2024 @08:04PM (#39185056)
Pub/Sub is meant to follow the Kafka "insane amounts of data" firehose pattern. Everyone thinks they need that scale unfortunately and skips over Cloud Tasks.
Re:The Big Little Guide to Message Queues by Spivak on Monday January 29, 2024 @09:14PM (#39185608)
The Kafka pattern isn't about the size of your data, it's about accommodating heterogeneous consumers and easy fan-out. I don't love the ampq exchange model because it adds state to the middle of the queue.
Re:The Big Little Guide to Message Queues by xyzzy_plugh on Monday January 29, 2024 @07:52PM (#39184944)
Pub/Sub is truly the stuff of nightmares compared to Tasks. I wish Tasks were a little more loved, because I keep ending up using Pub/Sub inevitably.
Re:The Big Little Guide to Message Queues by sudhirj on Monday January 29, 2024 @11:57PM (#39186526)
Wasn’t this on AppEngine in the early days? Yeah, if this is the same thing it’s probably the first queue I learnt / used. Will add it in.
Re:The Big Little Guide to Message Queues by swyx on Tuesday January 30, 2024 @07:56AM (#39189541)
(as someone who has pitched orchestration vs choreography) why don’t you like the jargon?