...but just as pyspark is not “pythonic”, clojure spark is super unidomatic to use. ...which is why its languished unused.

I mean, an idiomatic library isn’t impossible; see how databricks has wrapped the pandas api up with its koalas project; you just have invest the time and effort and actually make it.... for what, fundamentally, is a total absence of demand.

or do you mean like first party support for clojure? Thats never going to happen...

[1] https://github.com/gorillalabs/sparkling/