Re:Wallaroo: a fast, scalable data processing engine
by spooneybarger on Thursday September 28, 2017 @05:47PM
(#15361020)
We read in large chunks of messages at a time and start processing them. Some messages wait longer in internal queues for CPU time to become available to process them.
The benchmark we use is intentionally very light computationally. We did that because, if we had a heavy computation then the overhead from Wallaroo would be hidden.
The benchmark we use is intentionally very light computationally. We did that because, if we had a heavy computation then the overhead from Wallaroo would be hidden.