Parquet and ORC's many shortfalls for machine learning, and what to do about it?

Posted by abadid on Tuesday January 07, 2025 @06:05PM
from the starburst.io dept.

https://www.starburst.io/blog/parquet-orc-machine-learning/

( 1 comment | 3 points | on HN )

Re:Parquet and ORC's many shortfalls for machine learning, a... by abadid on Tuesday January 07, 2025 @06:05PM (#42628797)

This article summarizes research from my lab in collaboration with ByteDance published in CIDR (a computer science conference held in Amsterdam two weeks from now) on a new columnar format designed for ML workloads.

[ Parent | on HN ]