Not familiar with spark beyond being aware of it. We have a good amount of space allocated on a fairly powerful oracle server. Was thinking to store all of our tables there. If there are big advantages over an alternate system, I could get it done but would have to get the IT software team on board with letting me install it, getting a server, etc.

Jupyter have used but was thinking to have the team settle on mainly using SAS code to built the ETL process since that is the language most of them are familiar with using. (even though I personally HATE writing SAS)