Re:posix-spawn: a faster fork+exec for ruby
by kscaldef on Friday March 04, 2011 @01:25AM
(#2287194)
I'm curious what the applications are where this is an important optimization. Even for the very large Linux processes, it looks like 1/10sec per fork. On OSX, we're talking milliseconds. What sort of application is forking so often that this matters?
[ Parent
| on HN ]
Re:posix-spawn: a faster fork+exec for ruby
by JoachimSchipper on Friday March 04, 2011 @02:35AM
(#2287340)
If you use a basic process-per-connection model (select/fork/accept), 10 forks per second is not that much. The "classic Unix" Ruby HTTP servers like Unicorn do just that. (Apache 1.3 and at least one 2.x worker module also work this way, but Apache uses some tricks like preforking and recycling workers to make this fast - I'm not sure the Ruby servers do, too.)
Unicorn pre-forks workers upfront. New processes are not created per request.
posix-spawn is also only useful for fork+exec, where the new process starts executing a new binary. This is not the case in unicorn or resque, where the child processes actually need to be copies of the parent.
We're currently using posix-spawn in albino and grit, which execute external commands like `pygmentize` and `git`
Re:posix-spawn: a faster fork+exec for ruby
by JoachimSchipper on Friday March 04, 2011 @03:58AM
(#2287517)
Yes, you're right, of course. Sorry.