Show HN: Redis-pipe – Use Redis lists like Unix pipes

Re:Show HN: Redis-pipe – Use Redis lists like Unix pipes by waitingkuo on Wednesday April 08, 2015 @09:04AM (#9340435)

What's the benefit to use Redis pipe instead of Unix pipes?

[ Parent | on HN ]

Re:Show HN: Redis-pipe – Use Redis lists like Unix pipes by bytesandbots on Wednesday April 08, 2015 @09:13AM (#9340502)

I guess it might be very useful in a cloud like environment where you use this set up to pipe data across scaled up servers.

[ Parent | on HN ]

Re:Show HN: Redis-pipe – Use Redis lists like Unix pipes by morgenkaffee on Wednesday April 08, 2015 @09:19AM (#9340527)

I use it as a poor man's job queue.

cat jobs.txt | redis-pipe jobs

An then on several workers: redis-pipe --count 10 jobs | python do-work.py | redis-pipe results

An then in the end: redis-pipe results > results.txt

Or you can use it as simple logging mechanism: tail -f /var/log/syslog | ./redis-pipe logs

[ Parent | on HN ]

Re:Show HN: Redis-pipe – Use Redis lists like Unix pipes by eddd on Wednesday April 08, 2015 @09:45AM (#9340703)

Poor man's job queue is celery with redis backend i guess.

[ Parent | on HN ]

Re:Show HN: Redis-pipe – Use Redis lists like Unix pipes by morgenkaffee on Wednesday April 08, 2015 @09:58AM (#9340773)

Mine is even more poor :)

[ Parent | on HN ]