We don't need data scientists, we need data engineers

Re:We don't need data scientists, we need data engineers by aqme28 on Thursday January 14, 2021 @11:37AM (#25778431)

> you have a bunch of Data Scientists just handed a pg_dump or flat file from some ops team.

I feel seen. At a previous job, our output after some cleaning and transforming was a pg_dump for the data scientists to load. We had little visibility of what they did to that database once they got it.

[ Parent | on HN ]

Re:We don't need data scientists, we need data engineers by nitrogen on Thursday January 14, 2021 @01:13PM (#25779864)

I suspect in rare cases this is by design, because engineers would object to the behavior of the Business Intelligence department on ethical grounds.

[ Parent | on HN ]

Re:We don't need data scientists, we need data engineers by aqme28 on Thursday January 14, 2021 @04:30PM (#25782890)

If anything, we would have objected to the quality of the code they were writing.

[ Parent | on HN ]