News for hackers. Stuff that matters.
Re:PySpark Style Guide by gostsamo on Wednesday October 21, 2020 @05:01AM (#24846011)
> The preferred option is more complicated, longer, and polluted - and correct.

This is the definition of bad design.

Re:PySpark Style Guide by dazfuller on Wednesday October 21, 2020 @07:10AM (#24846614)
So much eye rolling. It's a mixture of some common sense, some bad suggestions (such as this one), and a couple of mandates such as "It is highly recommended to avoid UDFs in all situations" rather than providing any real guidance.
Re:PySpark Style Guide by jeroenvlek on Wednesday October 21, 2020 @05:25AM (#24846118)
Was also rolling my eyes at that one. Furthermore, if you are this concerned with the refactoring limitations of your IDE, then don't use Python, but the Scala or Java API instead.