News for hackers. Stuff that matters.

A comment on Anyscale, from the creators of the Ray distributed computing project, launches. Parent comment

Re:Anyscale, from the creators of the Ray distributed comput... by richardliaw on Wednesday December 18, 2019 @07:36PM (#21830993)
Interesting. What do you mean when you say: "versus the authors re-applying some of same research in their own thing."

And does "code distribution" just mean to release as open source?

[ Parent | on HN ]
Re:Anyscale, from the creators of the Ray distributed comput... by choppaface on Wednesday December 18, 2019 @09:32PM (#21831574)
code distribution I mean like cloudpickle. Which Ray has, but I wonder about an equivalent to Spark files (torrented and cached). A Kubernetes runner is also important ...

I wish the Ray peeps would consider just trying to merge some with the Spark RDD API. Reynold (at Databricks) is kinda hard to deal with, but so far to me it looks like the aim of having Ray team build things from the ground up has simply re-validated a lot of the systems work (but not all) that’s already in Spark.

[ Parent | on HN ]