Re:Computer Scientists Discover Limits of Gradient Descent
by mjfisher on Sunday July 30, 2023 @02:37AM
(#36928494)
So is it just a fancy way of saying "every transformation has an axis or origin"?
[ Parent
| on HN ]
Re:Computer Scientists Discover Limits of Gradient Descent
by Elyra on Sunday July 30, 2023 @03:12AM
(#36928656)
This is also how I interpreted it, which I take it is probably incorrect and would like to know why.
Re:Computer Scientists Discover Limits of Gradient Descent
by nerdponx on Sunday July 30, 2023 @03:34AM
(#36928773)
* * *
Re:Computer Scientists Discover Limits of Gradient Descent
by tomrod on Sunday July 30, 2023 @09:03AM
(#36930766)
No, you are on point.
Re:Computer Scientists Discover Limits of Gradient Descent
by l__l on Sunday July 30, 2023 @03:54AM
(#36928877)
That's not the best way to view it. You can prove it by showing that for an n-dimensional disc, there is no contraction to its boundary; which I think is a bit more illustrative of what this FPT is doing
Re:Computer Scientists Discover Limits of Gradient Descent
by tsimionescu on Sunday July 30, 2023 @03:58AM
(#36928900)
Well, some continuous functions are simple and it's highly intuitive why this applies to them. Others are very weird and it's not intuitive at all that they should have such a point.
And of course, some functions/transformations are not continuous, and those may not have such an "axis of origin" at all.
Re:Computer Scientists Discover Limits of Gradient Descent
by r0uv3n on Sunday July 30, 2023 @01:24PM
(#36933590)
I don't quite know what you mean by that, but consider that this is not true for e.g. a torus or a sphere (take the function mapping every point to its antipodal point).
The fact that the underlying space is contractible is very important here.