News for hackers. Stuff that matters.

A comment on Apache Storm 1.0 released.

Re:Apache Storm 1.0 released by therealdrag0 on Tuesday April 12, 2016 @01:23PM (#11481539)
Wow. Good work Storm people! Some nice features here.

Anyone privy to what changes they made to yield the performance improvements?

[ Parent | on HN ]
Re:Apache Storm 1.0 released by lovelearning on Tuesday April 12, 2016 @01:37PM (#11481691)
From the issue log :

"Profiling a simple speed of light topology, shows that a good chunk of time of the SpoutOutputCollector.emit() is spent in the clojure reduce() function.. which is part of the ACK-ing logic. Re-implementing this reduce() logic in java gives a big performance boost in both in the Spout.nextTuple() and Bolt.execute()"

[1]: https://issues.apache.org/jira/browse/STORM-1539

[ Parent | on HN ]
Re:Apache Storm 1.0 released by kabhwan on Tuesday April 12, 2016 @06:45PM (#11484233)
Apache Storm 1.0.0 introduces batching internal disruptor queue which adds latencies slightly (but with timeout set to 1ms per each queue so it doesn't hurt) but gives huge throughput improvement.

https://github.com/apache/storm/pull/765

[ Parent | on HN ]
Re:Apache Storm 1.0 released by d3fun on Tuesday April 12, 2016 @01:48PM (#11481821)
More coming in the roadmap. We are also working performance improvements around internal queuing.
[ Parent | on HN ]