News for hackers. Stuff that matters.
Re:Announcing Spark 1.6 by _laf on Monday January 04, 2016 @06:24PM (#10839582)
This post: https://databricks.com/blog/2015/07/30/diving-into-spark-str...

In the section titled "Future Directions for Spark Streaming" there is a paragraph about Event time and out-of-order data and Backpressure. This would blow my mind to be able to use; this is a real pain currently.

Re:Announcing Spark 1.6 by peterstjohn on Monday January 04, 2016 @07:41PM (#10840063)
Backpressure is in 1.5+ by setting spark.streaming.backpressure.enabled=true (https://spark.apache.org/docs/latest/streaming-programming-g...). Like you, I'm looking forward to the out-of-order data support.