News for hackers. Stuff that matters.
Re:Amazon's Exabyte-Scale Migration from Apache Spark to Ray... by nubinetwork on Wednesday July 31, 2024 @09:09PM (#41125264)
> this is not a typical ray use case

Must be good enough if you're willing to dogfood it though?

Re:Amazon's Exabyte-Scale Migration from Apache Spark to Ray... by robertnishihara on Friday August 02, 2024 @08:57PM (#41143928)
To clarify, what I mean is that working with "exabytes" is atypical. Most use cases are at a slightly smaller scale :)

Data processing workloads are quite common on Ray, especially with unstructured data.

Also, I work on Ray, which is the underlying framework used here, but all the work in the post was done by the Amazon team.