Re:Data Engineering Design Patterns (DEDP)
by fifilura on Thursday December 07, 2023 @03:51PM
(#38561660)
How do you define "bad rep"?
[ Parent
| on HN ]
Re:Data Engineering Design Patterns (DEDP)
by opportune on Thursday December 07, 2023 @05:21PM
(#38562647)
A lot of “data engineers” are former db analysts and such that don’t know much of anything technically outside of SQL and even that might be something they only are “certified” to know rather than actually good at.
It’s basically becoming a title I’d associate with being low-skill. I used to be a “software engineer in data” and never call myself a data engineer because people would think I don’t know how to write/maintain production services, just write ETL pipelines
Re:Data Engineering Design Patterns (DEDP)
by fifilura on Friday December 08, 2023 @01:59AM
(#38566169)
Ok I guess you neew to find the worplace that suits you.
Just that I have had some recent experience with muti threaded java k8s services reading daily "streams" from Kafka.
When a SQL query would have solved it.
Re:Data Engineering Design Patterns (DEDP)
by free_flintshire on Friday December 08, 2023 @07:35AM
(#38568270)
Many such cases in the data space of CV building over problem solving
Re:Data Engineering Design Patterns (DEDP)
by fifilura on Friday December 08, 2023 @11:42AM
(#38570992)
I guess you have to decide what you want on your CV. "I solve problems" or "I build complex stuff".
Re:Data Engineering Design Patterns (DEDP)
by DanielVZ on Thursday December 07, 2023 @10:38PM
(#38565157)
I made the change from SWE to DE a few months ago and several fellow SWEs saw it a first glance as if I was downgrading into a less technical role. They assumed it was some kind of modern DBA.
I’ve always seen it as a Data Oriented Software Engineer but it seems that isn’t always the case, specially recently where I’ve been offered jobs that were basically analyst roles or BI roles.