News for hackers. Stuff that matters.
Re:The Unscalable, Deadlock-Prone, Thread Pool by xenadu02 on Tuesday February 26, 2019 @07:40PM (#19259861)
The issue the OP is addressing covers your comment quite well. Async continuations, coroutines, and fibers can all race ahead and exhaust memory/DB connections/network sockets, or just saturate the IO subsystem. In a multi-step process this can easily lead to starvation in downstream steps.

The point of structuring an application this way is to prevent any one stage of your pipeline from consuming too many resources or stalling other stages (or just hammering some other system with requests that will inevitably timeout).

I don’t see how your comment about fiber support in Java applies.

Re:The Unscalable, Deadlock-Prone, Thread Pool by agumonkey on Tuesday February 26, 2019 @07:51PM (#19259917)
I'd love to learn how to design this way, any reading ?
Re:The Unscalable, Deadlock-Prone, Thread Pool by ioquatix on Tuesday February 26, 2019 @09:09PM (#19260270)
I wrote a full stack implementation for Ruby: https://github.com/socketry/async

Come and chat here: https://gitter.im/socketry/async

TruffleRuby folks are trying to support us using native fibers in the JVM, but I'm not sure when that will be working.