News for hackers. Stuff that matters.
Re:Computer Scientists Discover Limits of Gradient Descent by mjfisher on Sunday July 30, 2023 @02:37AM (#36928494)
So is it just a fancy way of saying "every transformation has an axis or origin"?
Re:Computer Scientists Discover Limits of Gradient Descent by Elyra on Sunday July 30, 2023 @03:12AM (#36928656)
This is also how I interpreted it, which I take it is probably incorrect and would like to know why.
Re:Computer Scientists Discover Limits of Gradient Descent by nerdponx on Sunday July 30, 2023 @03:34AM (#36928773)
* * *
Re:Computer Scientists Discover Limits of Gradient Descent by tomrod on Sunday July 30, 2023 @09:03AM (#36930766)
No, you are on point.
Re:Computer Scientists Discover Limits of Gradient Descent by l__l on Sunday July 30, 2023 @03:54AM (#36928877)
That's not the best way to view it. You can prove it by showing that for an n-dimensional disc, there is no contraction to its boundary; which I think is a bit more illustrative of what this FPT is doing
Re:Computer Scientists Discover Limits of Gradient Descent by tsimionescu on Sunday July 30, 2023 @03:58AM (#36928900)
Well, some continuous functions are simple and it's highly intuitive why this applies to them. Others are very weird and it's not intuitive at all that they should have such a point.

And of course, some functions/transformations are not continuous, and those may not have such an "axis of origin" at all.

Re:Computer Scientists Discover Limits of Gradient Descent by r0uv3n on Sunday July 30, 2023 @01:24PM (#36933590)
I don't quite know what you mean by that, but consider that this is not true for e.g. a torus or a sphere (take the function mapping every point to its antipodal point).

The fact that the underlying space is contractible is very important here.