News for hackers. Stuff that matters.
Re:Polars Cloud: The Distributed Cloud Architecture to Run P... by Centigonal on Friday March 07, 2025 @08:39PM (#43296722)
Why scala spark over pyspark?
Re:Polars Cloud: The Distributed Cloud Architecture to Run P... by smu3l on Friday March 07, 2025 @08:51PM (#43296789)
Scala (and Java) has a typed Dataset api.[0] pyspark only provides the Dataframe API, which is not typed.

[0] https://spark.apache.org/docs/latest/sql-programming-guide.h...

Re:Polars Cloud: The Distributed Cloud Architecture to Run P... by Centigonal on Saturday March 08, 2025 @10:55AM (#43301133)
thanks!