News for hackers. Stuff that matters.
Re:Alice's adventures in a differentiable wonderland by kragen on Wednesday May 01, 2024 @12:30AM (#40219519)
you have an interesting point of view, and some of the things you have said are correct, but if you try to use gradient descent on a function from, say, ℤ → ℝ, you are going to be a very sad xanda. i would indeed describe such a function as being discontinuous not just at π but everywhere, at least with the usual definition of continuity (though there is a sense in which such a function could be, for example, scott-continuous)

even in the case of a single discontinuity in the derivative, like in relu', you lose the intermediate value theorem and everything that follows from it; it's not an inconsequential or marginally relevant fact

Re:Alice's adventures in a differentiable wonderland by jj3 on Wednesday May 01, 2024 @02:59AM (#40220344)
Note that any function ℤ → ℝ is continuous on its domain but nowhere differentiable.

A Scott-continuous function ℤ → ℝ must be monontonous. So not every such function is Scott-continuous.

Re:Alice's adventures in a differentiable wonderland by kragen on Wednesday May 01, 2024 @05:48PM (#40229945)
aha, thanks!