Congrats to Databricks for the latest major Spark release, their success, to that all started with the Spark framework ).. came a long way since I first deployed Spark 1.2 ( 10y + ago :)). See also https://www.databricks.com/blog/introducing-apache-spark-40