AthenaX – Uber Engineering’s Open Source Streaming Analytics Platform

Re:AthenaX – Uber Engineering’s Open Source Streaming Analyt... by nevi-me on Monday October 09, 2017 @03:21PM (#15436643)

Interesting project! I only got to know about Apache Calcite a few months/weeks ago, but it seems like it's becoming a de facto way of supporting SQL on analytics products. I can think of Dremio [1] as an example.

From an implementation perspective, I wonder how AthenaX will compare to the Apache Beam SQL DSL [2] (I haven't tried it out, still learning DoFn, ParDo, etc.). Beam is also leveraging Calcite, with the partial difference that it runs* on Flink amongst others.

I think it's safe to say that the streaming analytics ecosystem remains interesting and exciting! Hope I'll be able to try out AthenaX, congratulations on the release.

[1] https://www.dremio.com [2] https://github.com/apache/beam/tree/DSL_SQL

[ Parent | on HN ]

Re:AthenaX – Uber Engineering’s Open Source Streaming Analyt... by haohui on Monday October 09, 2017 @05:42PM (#15437730)

I'm not fully familiar with Apache Beam SQL DSL so I can't really provide anything insightful.

But yes streaming analytics is a very exciting area. Your feedbacks are appreciated.

[ Parent | on HN ]

Re:AthenaX – Uber Engineering’s Open Source Streaming Analyt... by nevi-me on Monday October 09, 2017 @09:47PM (#15438726)

I think it'll only be released in the next minor version. We currently need to build from source to try it, so I'm waiting for next version. I'm still learning the Java API, which is a lot for a few hours here and there.

In the blog post, you talk about running AthX on YARN, so am I correct in saying that I might not be able to run it on single-machine mode? I'd like to try it out (SQL window functions are easier to understand than Beam Java ones).

Maybe Gitter or a public Slack channel could help, more users will have queries that aren't suitable for HN nor GitHub issues.

[ Parent | on HN ]

Re:AthenaX – Uber Engineering’s Open Source Streaming Analyt... by haohui on Tuesday October 10, 2017 @02:49AM (#15439878)

You can definitely start a single node Flink-on-YARN cluster. That's how all the integration tests are set up.

What do you think of posting the questions on the mailing list [1]?

[1] https://groups.google.com/forum/#!forum/athenax-users

[ Parent | on HN ]