Re:Stochastic gradient descent written in SQL
by haolez on Tuesday March 07, 2023 @10:17PM
(#35064786)
I've created a big system with only SQL in the past like you just said. I wouldn't do it again because of these two pain points that I had to deal with:
1. it's really hard to debug SQL queries and stored procedures (at least it was in Postgres 11)
2. when you hit a performance bottleneck, you don't have much control over it - parallelizing is hard and you have to trick the query planner to do what you want (and it doesn't work sometimes)
Re:Stochastic gradient descent written in SQL
by dventimi on Wednesday March 08, 2023 @03:45PM
(#35074481)
Not challenging your experience but genuinely trying to learn from it, in broad strokes what kinds of things were you doing in these stored procedures?
1. it's really hard to debug SQL queries and stored procedures (at least it was in Postgres 11)
2. when you hit a performance bottleneck, you don't have much control over it - parallelizing is hard and you have to trick the query planner to do what you want (and it doesn't work sometimes)