News for hackers. Stuff that matters.
Re:The Birth of Parquet by jfim on Wednesday May 08, 2024 @12:55PM (#40300295)
Spend a few bucks on an EC2 instance with a few terabytes of RAM for an hour or so. u-3tb1.56xlarge is about $27/hr.
Re:The Birth of Parquet by nucleardog on Thursday May 09, 2024 @02:11AM (#40305715)
This is the answer for a one-off or occasional problem unless your time is worthless.

$200 to rent a machine that can run the naive solution for an entire day is peanuts compared to the dev time for a “better” solution. Running that machine for eight hours would only cost enough to purchase about a half day of junior engineer time.