Thanks for that pretty detailed write-up.

I hope you don't think I'm blaming your code base, but just out of pure curiosity, as an amateur question could you mention why the SQL calls couldn't be done in parallel -- did each one depend on the next or something?

At the high level I get everything you just said, just curious about this point, if you remember.