I've never seen a language used for ancillary purposes be the make or break on hiring for a role, it's always just been expected that you'd pick it up as you go. And IMO, python is the least offensive compared to stuff like Perl, Ruby (for Chef) or whatever the heck Terraform is.
I have onboarded dozens of Data Engineering graduates in using Spark.
In the beginning this was with Scala and every single one struggled with SBT.
Giving developers unlimited flexibility in how they create build files is a bad idea.
Can they use pyspark?
Re:Why does Mill use Scala?
by LorenzoGood on Thursday February 13, 2025 @07:33PM
(#43043244)
HCL?
Of course they are willing to learn for the role but making it hard for them in the beginning can forever turn them off a language. That has been a big problem with Scala and Spark.