Re:Why Zapier Doesn't Use Gevent Yet
by obeattie on Wednesday January 13, 2016 @03:51AM
(#10893088)
The outbound dispatcher here seems like a prime candidate to write in a different language (Go for instance). Presumably it just makes HTTP requests so can be very simple -- building the request payload for instance could still happen in Python. And as you use Celery you already have a message queue over which it could communicate with the rest of your application.
[ Parent
| on HN ]
There is not need to overdo it. Asyncio + threads will do nicely. 500 req/seq is not the end of the world. I have similar load on purely threaded systems and they work fine.
Crossbar.io would help though, but is not even necessary.
Re:Why Zapier Doesn't Use Gevent Yet
by robgolding on Wednesday January 13, 2016 @06:19AM
(#10893556)
We have considered this actually, and I think it will be something we look into more as our scale increases. As you say, we already have the communication infrastructure in place via Celery/RabbitMQ.