News for hackers. Stuff that matters.
Re:Should You Ditch Spark for DuckDB or Polars? by jaychia on Monday December 16, 2024 @06:01PM (#42436466)
Hey, I'm one of the developers of Daft :)

Thanks for the feedback on marketing! Daft is indeed distributed using Ray, but to do so involves Daft being architected very carefully for distributed computing (e.g. using map/reduce paradigms).

Ray fulfills almost a Kubernetes-like role for us in terms of orchestration/scheduling (admittedly it does quite a bit more as well especially in the area of data movement). But yes the technologies are very complementary!

There are no comments on this comment yet.