News for hackers. Stuff that matters.
Re:How do you cut a monolith in half? by coredog64 on Friday June 30, 2017 @11:30AM (#14671340)
Having been on the receiving end of more than a few apps where the devs used a database as a queue, I say "please don't".

Yes, Oracle's AQ product is built on top of an RDBMS. And yes, early versions of Microsoft's MSMQ used SQL Server. But most dev teams use the database as a shortcut and don't invest the effort in making their hacktastic DB queue work like a real product.

Re:How do you cut a monolith in half? by balfirevic on Friday June 30, 2017 @11:53AM (#14671519)
I have used DB as queues very successfully in multiple projects (as well as "real" queues in others), so your "please don't" is not very persuasive. Some actual argument, instead of content-free "hacktastic" vs. "real product" designations would be appreciated.

And you use "shortcut" like some kind of negative attribute. Of course they use DB as a shortcut, and they should - it works well and even has additional features (transactions with your primary store) that you wouldn't get with separate queue product.

Re:How do you cut a monolith in half? by FLUX-YOU on Friday June 30, 2017 @12:57PM (#14671993)
Monitoring and administration are more difficult until you write them yourself, especially if you are splitting monolithic code. Many of the message queue products you download include these. Can your DB message queue also support different queue concepts and message routing?
Re:How do you cut a monolith in half? by balfirevic on Friday June 30, 2017 @02:56PM (#14672930)
In my case it supported multiple queues (also, a concept of hierarchical queues), but no message routing. As for administration and monitoring - you are correct, you don't get it out of the box. Well, you do get some basic administration for free from whoever administers your database :)

On the other hand, you can grow solution for those organically over time to fit your needs.

Re:How do you cut a monolith in half? by rangersanger on Friday June 30, 2017 @12:57PM (#14671983)
In a previous life I was on a team that moved a ecomm backend-Email Service Provider(ESP) from a postgres based queue to rabbitMQ. The motivation was voiced in language similar to yours, "hacktasic" was actually used more than once as a reason to replace the DB with rabbitMQ.

In the end, I'd say they were equally reliable, but from a data analyst's perspective I very much missed the postgres based queue. I think the mechanics inherent to a database solution prompted the original implementers to keep messages around over time vs the mechanics inherent to an MQ solution where they became ephemeral (on the senders side.) Having access to those messages was a treasure trove for troubleshooting and for analytics. That and from a pure cost benefit stance, sending 10-20k messages a day to the ESP definitely didn't necessitate the expensive rearchitecture, as the DB solution was more than capable of handling the load on cheap hardware.

Re:How do you cut a monolith in half? by sbov on Friday June 30, 2017 @01:15PM (#14672137)
Yeah, at 10-20k it definitely sounds like overkill. Some of our past systems sent a couple million emails per day using a MySQL backed email queue.