News for hackers. Stuff that matters.
Re:Amazon's Exabyte-Scale Migration from Apache Spark to Ray... by robertnishihara on Friday August 02, 2024 @08:57PM (#41143928)
To clarify, what I mean is that working with "exabytes" is atypical. Most use cases are at a slightly smaller scale :)

Data processing workloads are quite common on Ray, especially with unstructured data.

Also, I work on Ray, which is the underlying framework used here, but all the work in the post was done by the Amazon team.

There are no comments on this comment yet.