Re:Do we need a third Apache project for columnar data repre...
by indogooner on Tuesday October 31, 2017 @02:24PM
(#15595361)
Thanks wesm for clearing this. My understanding (albeit limited) of Arrow was that it would complement Parquet. An example would be speeding up the in-memory representation of Parquet files. I believe mitigating the serialization costs will also help projects like PySpark.
Looking forward to your post.