News for hackers. Stuff that matters.
Re:Computer Scientists Discover Limits of Gradient Descent by l33t233372 on Sunday July 30, 2023 @06:35AM (#36929770)
It’s difficult to discuss this physical example because particles are discrete.

In an ideal system with points instead of particles, shaking would be continuous.

Re:Computer Scientists Discover Limits of Gradient Descent by Someone on Sunday July 30, 2023 @09:05AM (#36930789)
And then, we would not call it shaking but bending and twisting, would we?

Think of the 1D variant. If you shuffle a deck of cards, but require that to be ‘continuous’, few shuffles remain (I think only the identity mapping and ‘flipping the deck upside down’). I doubt anybody would restricting the possible permutations that much stil call shuffling.

Re:Computer Scientists Discover Limits of Gradient Descent by l33t233372 on Sunday July 30, 2023 @03:58PM (#36935290)
I don’t think that analogy works because an idealized fluid is point particles, but an idealized deck of cards isn’t.
Re:Computer Scientists Discover Limits of Gradient Descent by plonk on Monday July 31, 2023 @03:08PM (#36947359)
They both have a concept of neighbors but the deck of cards is simpler, it’s a good illustration, no?
Re:Computer Scientists Discover Limits of Gradient Descent by l33t233372 on Tuesday August 01, 2023 @11:43AM (#36957540)
I think point particles are different because there are infinitely many of them. They are more continuous than cards. This means shaking isn’t necessarily discontinuous even if two particles that were “right next to each other” wind up far apart, there should be more particles in between that ended up closer.