News for hackers. Stuff that matters.
Re:Apache Arrow 3.0 by groceryheist on Wednesday February 03, 2021 @08:15PM (#26021407)
You can configure Spark to use arrow for passing data between Java and Python via spark.sql.execution.arrow.pyspark.enabled but yes, Spark uses Java datatypes internally.

There are no comments on this comment yet.