Re:Data engineering and software engineering are converging
by itsoktocry on Friday August 29, 2025 @08:31PM
(#45070899)
Ironic, since "Data Engineers" are probably far more in demand right now than "Software Engineers".
Re:Data engineering and software engineering are converging
by ozim on Friday August 29, 2025 @09:39PM
(#45071190)
Only in places silly enough to believe software devs/enga cannot write SQL.
Re:Data engineering and software engineering are converging
by majormajor on Saturday August 30, 2025 @12:33AM
(#45071937)
The "write SQL for ETLs all day" job is a risky one right now since LLMs really lower the barrier for dealing with gnarly SQL. So it's still not a bad time to have your resume be as clear as possible that you're the "deals with complex distributed systems" SWE type instead.
Re:Data engineering and software engineering are converging
by mrugge on Saturday August 30, 2025 @01:03AM
(#45072033)
That's more of an analytics engineer role. LLMs lower the barrier to entry, but popular SQL queries are about correctness and flexibility and this often requires deep understanding and ownership of each filter and window function. This lower barrier can quickly can turn into enough rope to hang yourself.
Re:Data engineering and software engineering are converging
by CyberDildonics on Saturday August 30, 2025 @09:26AM
(#45074476)
Why would a software engineer not be able to do both roles?
Re:Data engineering and software engineering are converging
by omgwtfbyobbq on Sunday August 31, 2025 @08:07PM
(#45088249)
They can, but it takes time away from software engineering.
Along the same reason, that's why there are DBAs, dev-ops engineers, etc...
Likewise, we had to steer HR away from “data engineer” because we got very mixed results with candidates.