News for hackers. Stuff that matters.

A comment on Query Parquet files in SQLite.

Re:Query Parquet files in SQLite by brianoconnor on Sunday June 24, 2018 @02:27AM (#17385270)
Nice work! How did you convert csv to parquet? That is the step I currently struggle with, most tools I found require me to run some kind of server part.
[ Parent | on HN ]
Re:Query Parquet files in SQLite by simonw on Sunday June 24, 2018 @02:59AM (#17385365)
The author released a tool called csv2parquet about 3 hours ago: https://github.com/cldellow/csv2parquet
[ Parent | on HN ]
Re:Query Parquet files in SQLite by tmitchel2 on Sunday June 24, 2018 @03:59AM (#17385517)
I use Apache drill, selecting from a CSV table into a Parquet table. If you use AWS they now provide the ability to convert also.
[ Parent | on HN ]