News for hackers. Stuff that matters.
Re:Faust: Stream Processing for Python by ludwigvan on Wednesday August 01, 2018 @05:49AM (#17661026)
How does compare with Celery, given the author of both libraries is the same?

Is it an apple and oranges comparison? When would one use this instead of Celery?

Found the following for those curious: http://faust.readthedocs.io/en/latest/playbooks/vscelery.htm...

Re:Faust: Stream Processing for Python by vvatsa on Wednesday August 01, 2018 @06:23AM (#17661202)
Re:Faust: Stream Processing for Python by randlet on Wednesday August 01, 2018 @08:36AM (#17661889)
I guess the libraries ultimately serve different purposes but the Celery example is 100 times more approachable than the Faust example.
Re:Faust: Stream Processing for Python by asksol on Thursday August 02, 2018 @01:59PM (#17673770)
Yes, they do serve different purposes but they also share similarities. You could easily write a task queue on top of Faust.

It's important to remember that users had difficulty understanding the concepts behind Celery as well, perhaps it's more approachable now that you're used to it.

Using an asynchronous iterator for processing events enables us to maintain state. It's no longer just a callback that handles a single event, you could do things like "read 10 events at a time", or "wait for events on two separate topics and join them".