Re:Pandas on Ray – Early Lessons from Parallelizing Pandas
by jamesblonde on Sunday July 08, 2018 @03:50AM
(#17482615)
Ray is, like YARN, a resource manager - but it's lightweight and fast. Kind of like Erlang is for a lightweight process model, Ray can start tens of thousands of containers with much lower latency than YARN or Mesos or Kubernetes.
It has found a niche in distributed Reinforcement Learning (deep RL), and is establishing a beach-head there. Now it faces the chasm....
[ Parent
| on HN ]
There are no comments on this comment yet.