News for hackers. Stuff that matters.

A comment on Amazon's Exabyte-Scale Migration from Apache Spark to Ray on Amazon EC2. Parent comment

Re:Amazon's Exabyte-Scale Migration from Apache Spark to Ray... by cmollis on Wednesday July 31, 2024 @05:38PM (#41123731)
exactly.. parquet is good for append only.. stream mods to parquet in new partitions.. compact, repeat.
[ Parent | on HN ]

There are no comments on this comment yet.