News for hackers. Stuff that matters.
Re:Data Engineering Design Patterns (DEDP) by opportune on Thursday December 07, 2023 @05:21PM (#38562647)
A lot of “data engineers” are former db analysts and such that don’t know much of anything technically outside of SQL and even that might be something they only are “certified” to know rather than actually good at.

It’s basically becoming a title I’d associate with being low-skill. I used to be a “software engineer in data” and never call myself a data engineer because people would think I don’t know how to write/maintain production services, just write ETL pipelines

Re:Data Engineering Design Patterns (DEDP) by fifilura on Friday December 08, 2023 @01:59AM (#38566169)
Ok I guess you neew to find the worplace that suits you.

Just that I have had some recent experience with muti threaded java k8s services reading daily "streams" from Kafka.

When a SQL query would have solved it.

Re:Data Engineering Design Patterns (DEDP) by free_flintshire on Friday December 08, 2023 @07:35AM (#38568270)
Many such cases in the data space of CV building over problem solving
Re:Data Engineering Design Patterns (DEDP) by fifilura on Friday December 08, 2023 @11:42AM (#38570992)
I guess you have to decide what you want on your CV. "I solve problems" or "I build complex stuff".