News for hackers. Stuff that matters.
Re:Show HN: KQ – Simple Job Queue for Python Using Kafka by reubano on Tuesday November 01, 2016 @01:42AM (#12843665)
Why should I use this over the simplier RQ?
Re:Show HN: KQ – Simple Job Queue for Python Using Kafka by joowani on Tuesday November 01, 2016 @09:27AM (#12845489)
RQ is certainly useful (with finer control over messages), but we've been having a lot of problems with it lately in production due to it being memory bound (Redis). Improper code deploys or insufficient/stuck workers would quickly explode the queues and make the broker go oom in matter of hours. Memory is also very expensive. With KQ/Kafka I was hoping it would provide us with a lot more to buffer for human errors and scale better.
Re:Show HN: KQ – Simple Job Queue for Python Using Kafka by reubano on Saturday November 05, 2016 @11:18AM (#12880084)
Ok, that makes sense. I've never dealt with the scale you are talking about so have yet to run into these issues with redis. It may be best to put this info in the readme so people can decide for themselves when to use RQ or KQ.
Re:Show HN: KQ – Simple Job Queue for Python Using Kafka by brianwawok on Tuesday November 01, 2016 @08:38AM (#12845121)
Or the proven Celery
Re:Show HN: KQ – Simple Job Queue for Python Using Kafka by dozzie on Tuesday November 01, 2016 @08:48AM (#12845196)
Re:Show HN: KQ – Simple Job Queue for Python Using Kafka by al2o3cr on Tuesday November 01, 2016 @06:32PM (#12850704)
Dunno why people would blame the Celery devs for that bug - if you're setting the clock on production servers to a non-monotonic TZ you are going to have a bad time.
Re:Show HN: KQ – Simple Job Queue for Python Using Kafka by dozzie on Wednesday November 02, 2016 @04:38AM (#12853066)
So you basically blame people for living in countries that use daylight saving time? O_O

Also, I would understand if it were tasks between 2AM and 3AM that run twice in transition from summer time to winter time (there are two 2:30 that day, after all), but the bug affected tasks scheduled for the middle of the day.

Re:Show HN: KQ – Simple Job Queue for Python Using Kafka by brianwawok on Tuesday November 01, 2016 @09:29AM (#12845509)
I mean, Celery is a pretty amazing library. It has flaws, but I doubt this new project has no flaws. They are just unknown still.

For that specific bug in question, does KQ have logic around DST switch? I was not able to find any. So it looks like you would have the same bug in KQ, right?