Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Pandas on Ray – Make Pandas faster.
import ray.dataframe as pd
https://github.com/ray-project/ray
Unlike Dask, Ray can communicate between processes without serializing and copying data. It uses a shared-memory object store within Apache Arrow:
http://arrow.apache.org/blog/2017/08/08/plasma-in-memory-obj...
Worker processes (scheduled by Ray's computation graph) simply map the required memory region into their address space.
There are no comments on this comment yet.
https://github.com/ray-project/ray
Unlike Dask, Ray can communicate between processes without serializing and copying data. It uses a shared-memory object store within Apache Arrow:
http://arrow.apache.org/blog/2017/08/08/plasma-in-memory-obj...
Worker processes (scheduled by Ray's computation graph) simply map the required memory region into their address space.