Re:Ensmallen: A C++ Library For Efficient Numerical Optimiza...
by flemishgun on Wednesday December 08, 2021 @04:59PM
(#29491104)
This toolkit was originally part of the mlpack machine learning library (https://github.com/mlpack/mlpack) before it was split out into a separate, standalone effort.
Re:Ensmallen: A C++ Library For Efficient Numerical Optimiza...
by nicwilson on Wednesday December 08, 2021 @06:49PM
(#29492128)
Yes, you use it to select the parameters of you optimiser, like step size and momentum schedules and other tuneable things. Look up MAML (meta abstract machine learning?)
Re:Ensmallen: A C++ Library For Efficient Numerical Optimiza...
by sadfev on Friday December 10, 2021 @09:54AM
(#29510556)
11 years ago, I did something like that. I was trying to use particle swarm optimization to efficiently update neural network weights, it didn’t work well.
Don’t ask me why I even tried, I was a dumb but code happy undergrad!
Re:Ensmallen: A C++ Library For Efficient Numerical Optimiza...
by Leszek on Wednesday December 08, 2021 @03:44PM
(#29490242)
I'm surprised this doesn't implement any sort of automatic differentiation (like dual numbers) - I guess you can use a separate library for that but it's quite a nice-to-have for optimization.
Re:Ensmallen: A C++ Library For Efficient Numerical Optimiza...
by patrick451 on Friday December 10, 2021 @08:23PM
(#29517505)
It is sort of frustrating that all these c++ numeric libraries build on top of different linear algebra packages. That makes it more challenging not only to integrate an external autodiff tool, but even just to use in your code.
Ensmallen appears to build on top of Armadillo. There is autodiff.github.io, but it builds on top of Eigen, as does Ceres and Sophus. Boost has some nice integration routines, but a lot of them only work with boost vectors/matrices.
Contrast this with the python ecosystem, where basically everybody uses numpy. That makes it so nice to be able to compose different scientific libraries together.
I'm sort curious how python didn't end up with 5 different competing array libraries.
Re:Ensmallen: A C++ Library For Efficient Numerical Optimiza...
by beached_whale on Wednesday December 08, 2021 @03:23PM
(#29489992)
I don't think modules are going to help with packaging. But vcpkg is getting pretty good, with C++'s ecosystem being the way it is. There is no one way, and it seems to allow for a multitude of build systems. I've been using it with it's newer manifest mode and mostly don't need to leave it these days.
What if you applied machine learning to machine learning?
Don’t ask me why I even tried, I was a dumb but code happy undergrad!
Ensmallen appears to build on top of Armadillo. There is autodiff.github.io, but it builds on top of Eigen, as does Ceres and Sophus. Boost has some nice integration routines, but a lot of them only work with boost vectors/matrices.
Contrast this with the python ecosystem, where basically everybody uses numpy. That makes it so nice to be able to compose different scientific libraries together.
I'm sort curious how python didn't end up with 5 different competing array libraries.
I hope with advent of modules we can get package manager half as good as cargo but for C++
There isn't an ensmallen package yet, but I wouldn't imagine it will take long and I guess it'll be a 20-30 line package.
http://conan.io/
(Personally I haven't used it yet)
https://github.com/gugarosa/opytimizer