News for hackers. Stuff that matters.
Re:Single dependency stacks by jrumbut on Wednesday February 09, 2022 @03:09PM (#30277762)
Getting good at solving problems with relational databases is a highly underrated skill.

They are really underutilized by many projects.

Not to say any other software is bad, just that keeping the stack simple can help small teams move quickly and not get bogged down fighting fires. Also, the paths to scale up the major RDBMSes are well documented and understood. With a newer service and many interacting systems in your back end you end up having to be a pioneer (which takes time away from implementing new features).

Re:Single dependency stacks by jaxrtech on Wednesday February 09, 2022 @03:42PM (#30278205)
Absolutely. I've also seen my fair share of horrendous home-grown "ETL" programs that waste more time shuffling bytes to and from database with poor ORM queries in loops, that could be done with a couple half decent SQL queries.

Probably the most useful things for me was learning relational algebra in college, and having been thrown on the deep end on a team that was very SQL heavy (not withstanding attempting to debug Oracle PL/SQL syntax errors while pulling your hair out about a missing closing parenthesis -- of which isn't the problem).

The usual challenge seems to be fetching data from external services or performing complex business that may conditionally load things -- things that can be awkward in procedural SQL. At the end of the day, you're building a messy ad-hoc dependency graph that is being manually executed very inefficiently. Would be better to just have your code just describe the dependency graph and treat each value transparently as a promise/future and then have a separate engine execute it.

Anyhow, something something monads with lipstick, I digress...

Re:Single dependency stacks by KptMarchewa on Wednesday February 09, 2022 @03:53PM (#30278328)
ETL using ORM? Really?
Re:Single dependency stacks by PeterisP on Thursday February 10, 2022 @11:12AM (#30288261)
Actual ETL systems would not, however, if you have a homegrown pile of scripts fulfilling the ETL role, I would not be surprised if those scripts would use ORM.
Re:Single dependency stacks by SteadBytes on Thursday February 10, 2022 @12:21PM (#30289435)
Agreed. Are there any resources you recommend for getting good at solving problems with relational databases?