News for hackers. Stuff that matters.
Re:Why Jupyter is data scientists’ computational notebook of... by MrPowers on Tuesday October 30, 2018 @10:29AM (#18336772)
I am a Spark data engineer and spend a lot of time in Scala / Python IDEs & browser notebooks. Databricks lets you package code as JAR / wheel files & attach the binaries to the cluster. I write all the complicated code in tested projects that are checked into GitHub & use the notebooks to invoke the functions and visualize results.

Folks that try to do all programming in notebooks typically drown in complexity and suffer.

Re:Why Jupyter is data scientists’ computational notebook of... by agibsonccc on Tuesday October 30, 2018 @11:01AM (#18337121)
Yeah I agree. We do something similar if we're using zeppelin or beaker. I organize it, put an uber jar in there and then run everything from there. That's a ton easier.