News for hackers. Stuff that matters.

A comment on Data engineering and software engineering are converging.

Re:Data engineering and software engineering are converging by banku_brougham on Friday August 29, 2025 @05:21PM (#45069526)
If are orchestrating pipelines in airflow or Prefect you are having to write the client software around those engines, and its a lot of python.

Another anecdatum: the data engineers role at Zillow is called "Software Development Engineer, Big Data"

[ Parent | on HN ]
Re:Data engineering and software engineering are converging by craneca0 on Friday August 29, 2025 @06:38PM (#45070205)
That's interesting with the Zillow anecdote. I wonder if the nuance in the title is actually correlated with a difference in behavior/culture/best practices/approach?
[ Parent | on HN ]