News for hackers. Stuff that matters.
Re:AthenaX – Uber Engineering’s Open Source Streaming Analyt... by rxin on Monday October 09, 2017 @11:01PM (#15438978)
Spark actually has probably the best standard SQL support among all open source big data frameworks. It can run all of TPC-DS queries without modifications.
Re:AthenaX – Uber Engineering’s Open Source Streaming Analyt... by haohui on Tuesday October 10, 2017 @03:39AM (#15440026)
TPC-DS evaluates against batch processing and it is great to hear that Spark supports all of them.

I think the space for streaming processing is still quickly evolving. Many features like stream-table joins, CTEs, streaming joins with late arrival data are unimplemented or do not even have clear semantics yet. It would be great to see a benchmarks like TPC-DS in the domain.