Re:Show HN: Redis-pipe – Use Redis lists like Unix pipes
by eddd on Wednesday April 08, 2015 @09:45AM
(#9340703)
Poor man's job queue is celery with redis backend i guess.
Re:Show HN: Redis-pipe – Use Redis lists like Unix pipes
by morgenkaffee on Wednesday April 08, 2015 @09:58AM
(#9340773)
Mine is even more poor :)
cat jobs.txt | redis-pipe jobs
An then on several workers: redis-pipe --count 10 jobs | python do-work.py | redis-pipe results
An then in the end: redis-pipe results > results.txt
Or you can use it as simple logging mechanism: tail -f /var/log/syslog | ./redis-pipe logs