So much eye rolling. It's a mixture of some common sense, some bad suggestions (such as this one), and a couple of mandates such as "It is highly recommended to avoid UDFs in all situations" rather than providing any real guidance.
Re:PySpark Style Guide
by jeroenvlek on Wednesday October 21, 2020 @05:25AM
(#24846118)
Was also rolling my eyes at that one. Furthermore, if you are this concerned with the refactoring limitations of your IDE, then don't use Python, but the Scala or Java API instead.
This is the definition of bad design.