News for hackers. Stuff that matters.
Re:Computer Scientists Discover Limits of Gradient Descent by l33t233372 on Sunday July 30, 2023 @03:40AM (#36928802)
Shaking a container is a good example I think, assuming the glass is convex.
Re:Computer Scientists Discover Limits of Gradient Descent by almostnormal on Sunday July 30, 2023 @05:09AM (#36929320)
Erratic movement only occurs if the container isn't filled completely. If it is filled completely and the shaking doesn't include any turning/twisting motion, not much happens.
Re:Computer Scientists Discover Limits of Gradient Descent by mbeex on Sunday July 30, 2023 @08:19AM (#36930425)
Even then. The required mapping is 'onto' (otherwise, a discontinuous counterexample would be trivial). The air particles are equivalent to the water.
Re:Computer Scientists Discover Limits of Gradient Descent by plonk on Sunday July 30, 2023 @06:07AM (#36929616)
The paths are continuous, but if they move two neighbouring molecules away from each other, the final transformation won't be continuous, will it?
Re:Computer Scientists Discover Limits of Gradient Descent by l33t233372 on Sunday July 30, 2023 @06:35AM (#36929770)
It’s difficult to discuss this physical example because particles are discrete.

In an ideal system with points instead of particles, shaking would be continuous.

Re:Computer Scientists Discover Limits of Gradient Descent by Someone on Sunday July 30, 2023 @09:05AM (#36930789)
And then, we would not call it shaking but bending and twisting, would we?

Think of the 1D variant. If you shuffle a deck of cards, but require that to be ‘continuous’, few shuffles remain (I think only the identity mapping and ‘flipping the deck upside down’). I doubt anybody would restricting the possible permutations that much stil call shuffling.

Re:Computer Scientists Discover Limits of Gradient Descent by l33t233372 on Sunday July 30, 2023 @03:58PM (#36935290)
I don’t think that analogy works because an idealized fluid is point particles, but an idealized deck of cards isn’t.
Re:Computer Scientists Discover Limits of Gradient Descent by plonk on Monday July 31, 2023 @03:08PM (#36947359)
They both have a concept of neighbors but the deck of cards is simpler, it’s a good illustration, no?
Re:Computer Scientists Discover Limits of Gradient Descent by l33t233372 on Tuesday August 01, 2023 @11:43AM (#36957540)
I think point particles are different because there are infinitely many of them. They are more continuous than cards. This means shaking isn’t necessarily discontinuous even if two particles that were “right next to each other” wind up far apart, there should be more particles in between that ended up closer.