Re:Ensmallen: A C++ Library For Efficient Numerical Optimiza...
by Leszek on Wednesday December 08, 2021 @03:44PM
(#29490242)
I'm surprised this doesn't implement any sort of automatic differentiation (like dual numbers) - I guess you can use a separate library for that but it's quite a nice-to-have for optimization.
[ Parent
| on HN ]
Re:Ensmallen: A C++ Library For Efficient Numerical Optimiza...
by patrick451 on Friday December 10, 2021 @08:23PM
(#29517505)
It is sort of frustrating that all these c++ numeric libraries build on top of different linear algebra packages. That makes it more challenging not only to integrate an external autodiff tool, but even just to use in your code.
Ensmallen appears to build on top of Armadillo. There is autodiff.github.io, but it builds on top of Eigen, as does Ceres and Sophus. Boost has some nice integration routines, but a lot of them only work with boost vectors/matrices.
Contrast this with the python ecosystem, where basically everybody uses numpy. That makes it so nice to be able to compose different scientific libraries together.
I'm sort curious how python didn't end up with 5 different competing array libraries.
Re:Ensmallen: A C++ Library For Efficient Numerical Optimiza...
by qwertz912 on Thursday December 09, 2021 @04:22AM
(#29495389)
Any recommendations here for standalone auto diff libraries?
Re:Ensmallen: A C++ Library For Efficient Numerical Optimiza...
by Leszek on Thursday December 09, 2021 @07:43AM
(#29496728)
I used the autodiff in Ceres in the past (http://ceres-solver.org/automatic_derivatives.html), but Autodiff (https://autodiff.github.io/) also looks pretty good.