News for hackers. Stuff that matters.

A comment on Python Practices for Efficient Code: Performance, Memory, and Usability. Parent comment

Re:Python Practices for Efficient Code: Performance, Memory,... by sandGorgon on Friday August 18, 2017 @02:25PM (#15048555)
for standalone programs, there is simply no better multi-processing library than gevent. Forget the libev performance thing, the api is super pleasant... even more so than asyncio.

When you use gevent to run explicit green threads, you do NOT monkey patch - you call the library functions. You only monkey patch if you want stuff happening for free. Which also works pretty well in production with gunicorn.. and yes with celery.

gevent is officially supported by celery - https://github.com/celery/celery/tree/master/examples/gevent

http://docs.celeryproject.org/en/latest/_modules/celery/conc...

[ Parent | on HN ]
Re:Python Practices for Efficient Code: Performance, Memory,... by andy_ppp on Friday August 18, 2017 @07:40PM (#15050598)
Sure, the example doesn’t monkey patch there though. My issues happened around complex multi part Chords and removing Gevent fixed stuff, but then eventually I moved away from celery too and just used Pikka and Rabbitmq directly. This gave me more control and allowed me to see what was happening more easily; celery sometimes seemed to hide exceptions from me. Glad you haven’t had issues.
[ Parent | on HN ]
Re:Python Practices for Efficient Code: Performance, Memory,... by srean on Saturday August 19, 2017 @06:42AM (#15052689)
Curious if you have tried or evaluated stackless in production. One doesnt hear a lot on stackless python these dsys. BTW this is for my education only, not advocating one over the other.
[ Parent | on HN ]
Re:Python Practices for Efficient Code: Performance, Memory,... by sandGorgon on Saturday August 19, 2017 @08:05AM (#15052934)
Not really. I'm really going with the community here and the recent community is huge.

Gevent works in production with celery and even newrelic works with pretty OK (not perfect)

When we are talking about production systems, I need the whole ecosystem to work. So I'd rather use vanilla Python with few libraries like gevent.

[ Parent | on HN ]