Re:Regularized Newton Method with Global $O(1/k^2)$ Convergence
by robbedpeter on Tuesday December 07, 2021 @11:04AM
(#29474036)
It's funny how many complex ideas are "just" simpler ideas mapped to the right sequence of steps. The jargon and naming conventions can obscure the idea from outsiders, but allows for brief and accurate communication. If they'd explained the idea Barney-style, they'd have needed twice as many pages.
Thanks for the breakdown, it makes the paper more accessible.
Re:Regularized Newton Method with Global $O(1/k^2)$ Convergence
by tubby12345 on Tuesday December 07, 2021 @02:48PM
(#29477334)
Math is about formalizing "simple ideas" so that they can be reasoned about exactly.
Re:Regularized Newton Method with Global $O(1/k^2)$ Convergence
by whatshisface on Tuesday December 07, 2021 @12:14PM
(#29475251)
Every idea in math is like that, because the rules of math are to do everything in little steps.
Re:Regularized Newton Method with Global $O(1/k^2)$ Convergence
by sorokod on Tuesday December 07, 2021 @11:51AM
(#29474883)
Well a simpler idea is in way like the initial guess for Newton-Raphson. Sometimes you get convergence and sometimes you don't
Re:Regularized Newton Method with Global $O(1/k^2)$ Convergence
by montebicyclelo on Tuesday December 07, 2021 @05:33PM
(#29479089)
Would be great to have a resource written like this that covers the rest of maths, (or in fact jargon in general).
Re:Regularized Newton Method with Global $O(1/k^2)$ Convergence
by ChrisLomont on Thursday December 09, 2021 @07:38PM
(#29505080)
The problem would be the resource would be too sloppy to be useful. For example, the phrase "Lipschitz: a space that isn’t too stretchy" doesn't tell you about the precise definition of Lipschitz, which is absolutely essential, and there are tons of names in math that would all be sloppified to "a space that isn’t too stretchy".
Not knowing precisely which definition you need for an application or which one you need for a proof to hold is essential for progress.
Math doesn't make up "jargon" for no reason. The names are to denote to professionals the least needed elements to make something true.
Re:Regularized Newton Method with Global $O(1/k^2)$ Convergence
by adampk on Tuesday December 07, 2021 @05:38PM
(#29479135)
I always thought biology would be easier to learn if instead of entity names based on old languages they were instead verbose descriptions
i.e. Mitochondria->PowerHouseOfTheCell
Convex objective: a bowl-like function, we want inputs that put us at the bottom of it
Lipschitz: a space that isn’t too stretchy
Hessians: second partial derivatives of the terms we’re optimizing (inputs we want)
Regularization: make the “fix by approx” procedure a bit more well behaved
Levenberg–Marquardt: another adaptation to make the fix procedure better