Re:NumPy Tricks and Pitfalls
by Woberto on Saturday December 23, 2017 @04:50PM
(#15996449)
I'm an engineering student that does programming and am wondering, can I ask what are some good resources to gain the appropriate background that would allow me to understand more of this notebook? I have used tools like Numpy but probably not very efficiently without understanding their strengths and weaknesses. What books or online courses should I look into to know about memory, flops, and things like that?
I should probably ask this somewhere else but I'm not sure what the appropriate forum is, if you could point me to where I should that would be great. Thank you!
Re:NumPy Tricks and Pitfalls
by CardenB on Saturday December 23, 2017 @05:18PM
(#15996557)
You shouldn’t be afraid to fail, man! Instead of doing something in Matlab, try it in numpy and just do some research to figure out what you want to do.
Eventually you’ll pick up tips from all your online resources, and you’ll realize you could have done some things better the whole time.
Re:NumPy Tricks and Pitfalls
by Waterluvian on Saturday December 23, 2017 @05:34PM
(#15996631)
Yes! There's many ways to learn. One way is essentially the brute force method: Google every Single thing until you get it. That's how I learned Nimoy when doing some basic image analysis.
Re:NumPy Tricks and Pitfalls
by minimaxir on Saturday December 23, 2017 @06:24PM
(#15996907)
Considering the top numeric Python libraries have dependencies on Numpy, including data manipulation (pandas), machine learning (scikit-learn) and deep learning (TensorFlow), you may want to narrow down the question.
Re:NumPy Tricks and Pitfalls
by kevmo314 on Saturday December 23, 2017 @06:05PM
(#15996808)
Perhaps for engineers, but for the rest of the scientific community it's pretty obvious: Rust doesn't have nearly the coverage that NumPy does. A quick check, I couldn't find a GMRES solver in Rust, which is extremely useful for solving large linear systems and hardly an obscure algorithm.
FWIW this is the same situation NumPy was in a while back ago, but instead of boldly asserting that what they had was enough, they looked to other prevalent languages to figure out what was missing and packages like pandas and statsmodels came out.
Re:NumPy Tricks and Pitfalls
by empath75 on Saturday December 23, 2017 @06:15PM
(#15996859)
As someone who likes rust, python is just easier to code for exploration and the kinds of advantages you get for using rust aren’t particularly relevant.
Re:NumPy Tricks and Pitfalls
by ubernostrum on Saturday December 23, 2017 @06:18PM
(#15996876)
The entire surrounding ecosystem. Which includes not just the core numpy/scipy libraries but the stats, modeling, ML, plotting, etc. Plus the wealth of other Python stuff it can integrate with (I work at an almost entirely Python shop -- data science people work in the same language as pipeline and application people, which is really an overlooked thing). Plus the ease of installation and management from Anaconda. Plus the notebook format for easy sharing. Plus... well, lots and lots and lots of things. "We have a fast numerical library" is step one of about ten thousand to achieving parity with what the Python/numpy/scipy ecosystem does.
Re:NumPy Tricks and Pitfalls
by marmaduke on Saturday December 23, 2017 @06:30PM
(#15996935)
They don’t compete since you could reimplement your compute kernels in Rust and use them directly or as (g)ufuncs with the numpy container, used by the whole science and data stacks (visualization stats etc). Numpy compute APIs are for prototyping or compute which isn’t CPU bottleneck.
So for the majority of numpy users Rust competes with the likes of Numba, Cython, etc, which are hard to beat if you’re already coding in Python.
https://notebooks.azure.com/smortaz/libraries/advanced-numpy...
Click Clone, Sign in, then Run
https://cocalc.com/share/4a5f0542-5873-4eed-a85c-a18c706e8bc...
Click "Open in CoCalc", then select all, copy.
I should probably ask this somewhere else but I'm not sure what the appropriate forum is, if you could point me to where I should that would be great. Thank you!
What you are after are books/courses on "architecture", I think. A classic book on the subject is Hennessy & Patterson.
https://www.amazon.com/Computer-Architecture-Sixth-Quantitat...
Eventually you’ll pick up tips from all your online resources, and you’ll realize you could have done some things better the whole time.
https://github.com/ASvyatkovskiy/PythonWorkshop/blob/Spring2...
FWIW this is the same situation NumPy was in a while back ago, but instead of boldly asserting that what they had was enough, they looked to other prevalent languages to figure out what was missing and packages like pandas and statsmodels came out.
So for the majority of numpy users Rust competes with the likes of Numba, Cython, etc, which are hard to beat if you’re already coding in Python.
Every once in awhile /r/rust will get a numerics post & discussion will mostly concede that there's still a ways to go to make this field ergonomic
https://github.com/tensorflow/rust