Re:Apache Arrow 1.0
by buryat on Monday July 27, 2020 @12:45PM
(#23966822)
where is it used in production?
[ Parent
| on HN ]
Here's a list (and as mentioned in my comment, Apache Spark, Pandas, turbodbc)
Spark uses it under the hood to interop between PySpark and JVM
Dremio is a really nice product built using arrow.
Apache Arrow? First thing the top of my head(given that I had to work with this these past few days), the python snowflake connector depends on it if you intend to fetch the results from snowflake as a pandas or dask dataframe. In other words - lots of places.
Re:Apache Arrow 1.0
by vertexclique on Monday July 27, 2020 @02:27PM
(#23967928)
(contributor here) At my company our proprietary database layout is based on Arrow. Our workload is analytical and we are using it for read mostly workloads.