The Niche Programmer

Re:The Niche Programmer by bogomipz on Sunday May 01, 2022 @01:02PM (#31226599)

What are the skill sets required? Proficiency in SQL seems like an obvious one but else needs to be in the toolbox so to speak?

[ Parent | on HN ]

Re:The Niche Programmer by beckingz on Sunday May 01, 2022 @05:49PM (#31229042)

Core is SQL + Python (or Java/Scala for the actual Engineering part).

Most of the data warehouse work is data transformation and scheduling, so Apache Airflow and writing DAGs in python is a large part. For some of the larger streaming things you've got Kafka and others.

Also every cloud has it's own stack that is sometimes worth using.

[ Parent | on HN ]

Re:The Niche Programmer by bogomipz on Sunday May 01, 2022 @10:45PM (#31230895)

Thanks, what's the name of the AWS stack? Is it worth using?

[ Parent | on HN ]

Re:The Niche Programmer by RhodesianHunter on Sunday May 01, 2022 @01:44PM (#31226977)

Kafka is a very useful one.

[ Parent | on HN ]