Re:Apache Arrow 3.0
by groceryheist on Wednesday February 03, 2021 @08:15PM
(#26021407)
You can configure Spark to use arrow for passing data between Java and Python via spark.sql.execution.arrow.pyspark.enabled but yes, Spark uses Java datatypes internally.
[ Parent
| on HN ]
There are no comments on this comment yet.