News for hackers. Stuff that matters.
Re:Show HN: Convert any screenshot into clean HTML code usin... by yu3zhou4 on Thursday November 16, 2023 @06:11AM (#38288166)
Specifically for neural networks, is there any alternative for backpropagation and gradient descent which guarantee finding the global minimum?
Re:Show HN: Convert any screenshot into clean HTML code usin... by b3kart on Thursday November 16, 2023 @06:41AM (#38288352)
Unlikely given the dimensionality and complexity of the search space. Besides, we probably don’t even care about the global minimum: the loss we’re optimising is a proxy for what we really care about (performance on unseen data). Counter-example: a model that perfectly memorises the training data can be globally optimal (ignoring regularization), but is not very useful.