Postgres is a great pub/sub and job server (2019)

Re:Postgres is a great pub/sub and job server (2019) by k1w1 on Friday December 17, 2021 @10:35PM (#29601349)

Beware of the scale up challenges with Redis. Redis can only utilize a single core. If you do anything sophisticated that needs to be atomic then you can't scale out to multiple servers, and you can't scale up to multiple cores.

At least with Postgres you can scale up trivially. Postgres will efficiently take advantage of as many cores as you give it. For scale out you will need to move to a purpose built queuing solution.

[ Parent | on HN ]

Re:Postgres is a great pub/sub and job server (2019) by fouadf on Saturday December 18, 2021 @01:33AM (#29602261)

Good point. My assumption is that the first hit would be memory usage, way before core usage.

There are many options for scaling:

- vertically scale by adding more memory

- start redis instance on another port (takes 1mb) if decided to add more cores on the same vm

- separate data into another vm

- sharding comes out of the box, but that would be my last resort

[ Parent | on HN ]