Ballista: Distributed Compute with Rust, Apache Arrow, and Kubernetes

Re:Ballista: Distributed Compute with Rust, Apache Arrow, an... by andygrove on Wednesday July 17, 2019 @03:35AM (#20457321)

Check out my previous benchmarks on Rust-based DataFusion vs JVM-based Apache Spark workloads. It isn't just about raw performance numbers but also about resource requirements (especially RAM requirements when using JVM or similar GC-based languages). There are order-of-magnitude differences.

[ Parent | on HN ]

Re:Ballista: Distributed Compute with Rust, Apache Arrow, an... by geezerjay on Wednesday July 17, 2019 @03:39AM (#20457339)

If you have tangible results then present your benchmarks. If you limit your marketing to empty claims regarding "the future" and vague assertions on performance then you're actually actively working to lower your credibility.

[ Parent | on HN ]

Re:Ballista: Distributed Compute with Rust, Apache Arrow, an... by andygrove on Wednesday July 17, 2019 @03:43AM (#20457359)

This is a personal open source project. I'm not sure I'm "marketing" it since I make zero dollars from this work.

For benchmarks, check out the past 18 months of posts on my blog. Here is the most recent:

https://andygrove.io/2019/04/datafusion-0.13.0-benchmarks/

[ Parent | on HN ]

[dead]

Re:Ballista: Distributed Compute with Rust, Apache Arrow, an... by andygrove on Wednesday July 17, 2019 @04:03AM (#20457456)

Benchmarks are rarely fair. They are often biased in favor of those producing the benchmarks, whether intentionally or not.

Whether you want to explore this more or not is your choice. Nobody is asking you to engage in this conversation. If you are not interested and/or are not enjoying the discourse here, feel free to move along.

[ Parent | on HN ]

Re:Ballista: Distributed Compute with Rust, Apache Arrow, an... by i4t on Wednesday July 17, 2019 @05:29AM (#20457799)

please, stop it.

[ Parent | on HN ]

Re:Ballista: Distributed Compute with Rust, Apache Arrow, an... by eklavya on Wednesday July 17, 2019 @03:52AM (#20457408)

Don't you think you are being unreasonably harsh? Why are you attacking somebody's open source project with such passion?

[ Parent | on HN ]

Re:Ballista: Distributed Compute with Rust, Apache Arrow, an... by andygrove on Wednesday July 17, 2019 @04:00AM (#20457439)

Thanks eklavya but it's completely normal on HN to have trolls criticizing other people's work. Best thing is to just ignore them. They can move on to criticize other posts. Much easier than contributing.

[ Parent | on HN ]