Re:Best way to annotate large parquet LLM logs without full ...
by hodgesrm on Monday December 29, 2025 @09:00AM
(#46420837)
If it's under a few terabytes, copy it to ClickHouse and store it in the native format, make your change, and dump it back out again. ClickHouse reads and writes Parquet very efficiently and supports efficient distribution of work across clusters. It's a rewrite but it's fast.
[ Parent
| on HN ]
There are no comments on this comment yet.