Re:Big data is dead (2023)
by jjgreen on Monday May 27, 2024 @11:51AM
(#40491899)
Please promote the use of .parquet files!
Maybe later
[ Parent
| on HN ]
Re:Big data is dead (2023)
by seabass-labrax on Monday May 27, 2024 @12:44PM
(#40492408)
Parquet is a file format, not a piece of software. 'apt install csv' doesn't make any sense either.
If you want to shine with snide remarks, you should at least understand the point being made:
$ apt-cache search csv | wc -l
225
$ apt-cache search parquet | wc -l
0There is no support for parquet in Debian, by contrast
apt-cache search csv | wc -l
259apt search would return tons of libparquet-java/c/python packages if it was popular.
Re:Big data is dead (2023)
by nostrademons on Monday May 27, 2024 @04:42PM
(#40494486)
It's more like "sudo pip install pandas" and then Pandas comes with Parquet support.
Pandas cannot read parquet files itself, it uses 3rd party "engines" for that purpose and those are not available in Debian
Re:Big data is dead (2023)
by nostrademons on Monday May 27, 2024 @05:56PM
(#40495134)
Ah yes, that's true though a typical Anaconda installation will have them automatically installed. "sudo pip install pyarrow" or "sudo pip install fastparquet" then.