News for hackers. Stuff that matters.

A comment on SQL Maxis: Why We Ditched RabbitMQ and Replaced It with a Postgres Queue. Parent comment

Re:SQL Maxis: Why We Ditched RabbitMQ and Replaced It with a... by polyrand on Tuesday April 11, 2023 @01:42PM (#35528489)
SQLite is missing some features like `SELECT FOR UPDATE`, but you can work around some issues with a few extra queries. I wrote litequeue[0] with this specific purpose. I haven't been able to use it a lot, so I don't have real-world numbers of how it scales, but the scaling limits depend on how fast you can insert into the database.

[0]: https://github.com/litements/litequeue

[ Parent | on HN ]
Re:SQL Maxis: Why We Ditched RabbitMQ and Replaced It with a... by st3fan on Tuesday April 11, 2023 @04:44PM (#35531293)
I wrote https://github.com/TinyWebServices/tqs a couple of years ago. It is modelled after SQS and runs in a single threaded Tornado server.

I don’t know how many messages per second it does but for a podcast crawling side project I have processed hundreds of millions of messages through this little Python wrapper around SQLite. Zero problems. It just keeps running happily.

[ Parent | on HN ]